Data Engineer II

We are looking for a Data Engineer II with strong GCP and data engineering expertise to build scalable data pipelines, transformations, and reusable data-platform solutions.

Responsibilities:

• Build and maintain production-grade ETL/ELT pipelines on GCP.
• Develop batch and incremental processing using BigQuery, Dataform/dbt, and Airflow/Cloud Composer.
• Build distributed processing solutions using Dataflow/Apache Beam or Dataproc/Spark/PySpark.
• Develop reusable, metadata-driven, and configuration-driven data components.
• Design data models, schemas, data contracts, and incremental/idempotent pipelines.
• Implement data quality, validation, reconciliation, monitoring, and lineage.
• Optimize BigQuery queries and pipelines for performance and cloud cost.
• Implement automated testing and CI/CD for data workloads.
• Troubleshoot production issues and perform root-cause analysis.
• Collaborate with data, platform, DevOps, architecture, and business teams.

Requirements:

• 4+ years of hands-on data engineering experience.
• Strong GCP, BigQuery, SQL, and Python expertise.
• Hands-on ETL/ELT development experience.
• Experience with Cloud Composer / Apache Airflow.
• Experience with Dataform and/or dbt.
• Experience with Dataflow/Apache Beam or Dataproc/Spark/PySpark.
• Strong understanding of data modelling and large-scale datasets.
• Experience with incremental/idempotent pipelines and data quality.
• Knowledge of Git, automated testing, CI/CD, monitoring, and troubleshooting.
• Ability to independently design and deliver production solutions.

Good to Have:

• Apache Iceberg / modern lakehouse technologies.
• Streaming / event-driven processing and CDC.
• Data Mesh / Data Product principles.
• Terraform / Infrastructure as Code.
• Experience building reusable platform components.
• Core Stack: GCP, BigQuery, GCS, SQL, Python, Dataform/dbt, Airflow, Dataflow/Beam, Spark/PySpark, Git, CI/CD.