GCP Data Engineer
Posted
Summary
Designs and maintains scalable ETL/ELT data pipelines on Google Cloud Platform using Python, BigQuery, Dataform, Cloud Composer (Airflow), Cloud Storage, and Pub/Sub, with Terraform-managed infrastructure. Day-to-day work covers data warehousing, large-scale data migration, SQL tuning, and cloud DLP/data governance.
- Strong expertise in Python and API Integration (REST APIs, JSON/XML, OAuth, error handling, and data ingestion frameworks).
- Hands on experience with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Secure Source Manager, Cloud Storage and Pub/Sub.
- Proven experience designing and implementing scalable ETL/ELT pipelines and cloud native data solutions.
- Strong understanding of Data Warehousing, dimensional modelling, and data lifecycle management.
- Experience delivering large scale Data Migration projects with data validation and reconciliation.
- Hands on experience with Cloud DLP, data governance, security, and compliance requirements.
- Advanced SQL skills, including performance tuning and complex data transformations.
- Experience using Terraform for Infrastructure as Code (IaC) and GCP resource deployment.
- Familiarity with CI/CD pipelines, Agile delivery practices, and enterprise integration patterns.
- Good to Have: Databricks, Data Quality, ServiceNow/Salesforce integrations and JIRA.