Data Engineer - Google Cloud Platform

Role Overview:

We are looking for a GCP Data Engineer with hands-on experience in Google Cloud Platform, BigQuery, Terraform, and Apache Airflow. The role involves designing, developing, and maintaining scalable data pipelines and cloud-based data solutions, ensuring reliable data processing, efficient query performance, and automated infrastructure management.

Responsibilities:

- Design, develop, and maintain scalable data pipelines and data processing workflows on Google Cloud Platform.

- Build and optimize BigQuery datasets, tables, SQL queries, and data models for efficient data processing and analytics.

- Develop and manage workflow orchestration using Apache Airflow, including scheduling, monitoring, and troubleshooting data pipelines.

- Use Terraform to provision, manage, and maintain cloud infrastructure through Infrastructure as Code practices.

- Monitor pipeline performance, troubleshoot data processing issues, and ensure data quality, reliability, and consistency.

- Implement best practices for data security, access management, scalability, and cost optimization.

- Collaborate with analytics, business, and engineering teams to understand data requirements and deliver reliable data solutions.

Requirements:

- 4 - 9 years of experience in data engineering or related roles.

- Hands-on experience with Google Cloud Platform (GCP), particularly BigQuery.

- Strong SQL skills and experience developing and optimizing data pipelines.

- Practical experience with Apache Airflow for workflow orchestration.

- Experience with Terraform for infrastructure provisioning and management.

- Understanding of data warehousing, data modeling, ETL/ELT processes, and cloud-based data architectures.

- Strong troubleshooting, analytical, and problem-solving skills.

- Familiarity with Python, CI/CD, and cloud security practices is an advantage.