Senior Data Engineer
Posted 2
views
Summary
Senior Data Engineer designing, building, and operating scalable batch and real-time data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS, Cloud Run), with Kafka-based ingestion, dbt transformations, and Medallion Architecture. Also supports ML/AI data needs, data quality, observability, and governance in a regulated environment.
We are looking for a Senior Data Engineer to join a team working on a modern data platform in a GCP environment.
Your responsibilities:
- designing, building and operating scalable data pipelines on GCP, including both batch and real-time processing,
- working with BigQuery, Cloud Composer/Airflow, GCS and Cloud Run,
- developing and maintaining data ingestion processes, including Apache Kafka-based solutions,
- developing data transformations and working with dbt,
- ensuring data quality, monitoring, observability, lineage and pipeline reliability,
- contributing to Medallion Architecture (Bronze/Silver/Gold),
- supporting Data Science teams with data pipelines for ML and AI workloads,
- participating in code reviews and contributing to engineering standards and best practices,
- working with data governance requirements, access control, auditability and change management.
Requirements:
- several years of hands-on experience building and operating production-grade data pipelines,
- strong practical knowledge of GCP, particularly BigQuery, Cloud Composer/Airflow, GCS and Cloud Run,
- strong SQL and Python skills,
- experience with Apache Kafka or other streaming technologies,
- experience with dbt and modern data transformation approaches,
- understanding of Medallion Architecture,
- experience with data quality, data contracts, lineage, observability and SLA/SLO monitoring,
- understanding of data governance and working with data in a regulated environment,
- strong problem-solving skills and the ability to work independently on complex, scalable solutions.