GCP Senior Data Engineer
Summary
Hands-on Technical Lead / Senior Data Engineer leading an offshore BAU Data Engineering team, maintaining and improving GCP data pipelines with a focus on BigQuery, Cloud Composer/Airflow, Python, and SQL production support.
π We're Hiring: Senior Data Engineer / Technical Lead
Experience: 10+ Years
Location: Remote
Shift: 2:00 PM β 11:00 PM IST
Role Overview
We are looking for a hands-on Technical Lead / Senior Data Engineer to lead a BAU Data Engineering team responsible for the stability, reliability, production support, and continuous improvement of data pipelines on GCP.
The role requires strong hands-on expertise across the Data Lake β Dimensions/Facts β Data Warehouse lifecycle, along with team leadership and production troubleshooting capabilities.
Key Responsibilities
- Lead and mentor an offshore BAU Data Engineering / Production Support team.
- Act as the technical escalation point for pipeline failures and data issues.
- Troubleshoot production issues and implement SQL fixes, DAG updates, backfills, and validations.
- Build and optimize Apache Airflow / Cloud Composer DAGs, including Jinja templating.
- Optimize BigQuery queries, partitioning, clustering, and cost.
- Develop Python automation to reduce recurring production issues and manual effort.
- Ensure strict ITIL, change management, testing, deployment, evidence, and rollback processes.
- Work closely with global/US teams and provide required working-hour overlap.
- Drive continuous improvement and reduce technical debt.
Mandatory Skills
β SQL Server
β Python
β Apache Airflow / Cloud Composer
β Hadoop
β Google BigQuery
β Data Lake
β Production Support / Incident Management
β Data Engineering Technical Leadership
Preferred Skills
- BigQuery SCD Type 1 & Type 2
- Partitioning & Clustering
- Kimball Data Warehouse methodology
- Star Schema, Dimensions & Facts
- Salesforce data integration
- GCP Data Engineering
- Python automation & API integration
- BAU / Production Support
- ITIL & Change Management
Interested candidates can share their updated resume.
To this Email address - hari.prasad@teceze.com