Cloud Data Engineer – GCP Migration & Transformation Specialist
Cloud Data Engineer – GCP Migration & Transformation Specialist
Experience Level:8+ years (with recent GCP project experience)
- Design and implement scalable data pipelines usingGCP BigQueryandCloud Composer, followingMedallion architectureprinciples.
- Leaddata model and data migrationsfrom on-premise platforms likeTeradataandClouderatoBigQuery, ensuring accuracy and performance.
- DevelopBigQuery SQL-based transformationsand standardELT conversion patterns(e.g., pushdown optimization, partitioning strategies, staging layer design).
- Map legacyInformatica workflowsandTeradata BTEQ scriptstoBigQuery SQL-based ELT solutions.
- MigrateControl-M workflowstoGCP Cloud Composer, ensuring orchestration compatibility and performance.
- Designmodular and reusable BigQuery pipeline patternsapplicable across multiple use cases.
- Collaborate with reporting teams to build dashboards and reports, ensuringBigQuery data type compatibilitywith tools such asQlikSense.
- Troubleshoot data pipeline issues, ensuring timely resolution and optimal system performance.
Job Role: Cloud Data Engineer – GCP Migration & Transformation Specialist
Experience Level:
8+ years (with recent GCP project experience)
Job Summary:
We are looking for a skilled Data Engineer with strong experience in Google Cloud Platform (GCP) and enterprise data migrations. The ideal candidate will have a deep understanding of the GCP data landscape, Medallion architecture, and hands-on experience in migrating data models and ETL pipelines from on-premise platforms such as Teradata and Cloudera to GCP BigQuery.
Key Responsibilities:
- Design and implement scalable data pipelines usingGCP BigQueryandCloud Composer, followingMedallion architectureprinciples.
- Leaddata model and data migrationsfrom on-premise platforms likeTeradataandClouderatoBigQuery, ensuring accuracy and performance.
- DevelopBigQuery SQL-based transformationsand standardELT conversion patterns(e.g., pushdown optimization, partitioning strategies, staging layer design).
- Map legacyInformatica workflowsandTeradata BTEQ scriptstoBigQuery SQL-based ELT solutions.
- MigrateControl-M workflowstoGCP Cloud Composer, ensuring orchestration compatibility and performance.
- Designmodular and reusable BigQuery pipeline patternsapplicable across multiple use cases.
- Collaborate with reporting teams to build dashboards and reports, ensuringBigQuery data type compatibilitywith tools such asQlikSense.
- Troubleshoot data pipeline issues, ensuring timely resolution and optimal system performance.
Required Skills & Experience:
- Strong working knowledge ofGCP services, includingBigQuery,Cloud Composer, and the overallGCP data ecosystem.
- Experience with in a cloud-based data platform.
- Hands-on experience withdata migration and transformation projectsfromTeradata,Cloudera, or similar on-premise systems toGCP.
- Proficiency inBigQuery SQLfor advanced data transformation tasks.
- Familiarity with standard data engineering patterns such aspartitioning,staging,modularity, andpipeline reusability.
- Experience in converting legacyInformaticaandBTEQworkflows to cloud-native solutions.
- Experience withQlikSenseor similar BI tools, including handling data type compatibility with BigQuery.
- Strongdebugging and issue resolution skillsin a cloud-based data environment.
- Experience withdata governance,data quality checks, andperformance tuningin BigQuery.
- Exposure toCI/CD practicesandinfrastructure as code(IaC) for pipeline deployments.