Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our dynamic team in Tamil Nadu. The ideal candidate will have a strong background in data engineering and be proficient in utilizing various tools and technologies to manage and optimize data workflows. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and maintain robust data pipelines using BigQuery and other data processing tools.
- Implement and manage workflows using Airflow, Composer, or Astronomer to ensure efficient data processing.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Write efficient and reusable code in Python and SQL to manipulate and analyze data.
- Utilize Terraform for infrastructure as code to manage cloud resources effectively.
- Ensure data quality and integrity throughout the data lifecycle.
- Stay updated with the latest trends and technologies in data engineering and cloud computing, particularly within the Google Cloud Platform (GCP).
Required Skills:
- Proficiency in BigQuery and experience with data warehousing solutions.
- Strong knowledge of workflow orchestration tools such as Airflow, Composer, or Astronomer.
- Expertise in programming languages, particularly Python and SQL.
- Familiarity with Terraform for infrastructure management.
- Experience with Google Cloud Platform (GCP) and its data services.
- Strong analytical and problem-solving skills, with a keen attention to detail.
If you are passionate about data engineering and eager to work in a collaborative environment, we encourage you to apply for this exciting opportunity.