Senior Data Engineer (10+ years) to support Teradata to BigQuery migration initiatives using BigQuery, Dataflow, Teradata, and SAS - 10289
S I Systems Senior Data Engineer (10+ years) to support Teradata to BigQuery migration initiatives using BigQuery, Dataflow, Teradata, and SAS - 10289
Summary
A 10+ year senior data engineer works on migrating a telecom client's analytical workloads from Teradata to BigQuery on GCP. Day to day they build batch and near-real-time pipelines with Dataflow, convert SAS/Teradata logic to SQL, and build validation/reconciliation between SAS and cloud outputs. Contract role, remote but candidates must be in Toronto or Mississauga.
Senior Data Engineer (10+ years) to support Teradata to BigQuery migration initiatives using BigQuery, Dataflow, Teradata, and SAS - 10289
Our Telecom client is seeking a Senior Data Engineer (10+ years) to support Teradata to BigQuery migration initiatives using BigQuery, Dataflow, Teradata, and SAS.
Join a data engineering initiative focused on modernizing analytical workloads and supporting migration from Teradata to BigQuery. This role focuses on building and optimizing batch and near-real-time data pipelines, reusable ingestion and orchestration frameworks, and cloud-native processing solutions. The position supports ongoing data engineering enhancements and validation of business outputs between SAS and cloud-based implementations.
Contract, Toronto, Remote (Candidate needs to be from Mississauga or Toronto)
Must Haves
- 10+ years in Data Engineering supporting large-scale data analytics initiatives
- BigQuery and GCP for cloud-native data processing and dataset optimization
- Teradata and SAS transformation and analytical workload modernization
- Dataflow for batch and near-real-time data pipeline development
Nice to Have
- Experience validating business outputs between SAS and cloud-based implementations
- Exposure to automated validation and reconciliation processes between source and target systems
Responsibilities
- Develop and maintain batch and near-real-time data pipelines using cloud-native technologies
- Build reusable data ingestion, transformation, and orchestration frameworks
- Optimize BigQuery datasets, partitioning, clustering, and query performance
- Develop automated validation and reconciliation processes to ensure data accuracy between source and target systems
- Convert SAS and Teradata-based transformations and business logic to SQL and cloud-native processing frameworks
- Support modernization of SAS analytical workloads leveraging BigQuery capabilities
- Validate business outputs between SAS and cloud-based implementations
- Experience with BigQuery, GCP, Teradata and SAS.
Disclaimer:
AI may be used in evaluating candidates.
This posting is for an existing vacancy.