Cloud Data Engineer (5+ years) to configure cloud environments and build data pipelines using Azure Synapse, ADF, Databricks, and Spark
Summary
Builds and maintains cloud data pipelines in Azure, migrating Synapse workflows to ADF/Databricks, testing, and deploying production data processes for a transportation ITSM project.
Cloud Data Engineer (5+ years) to configure cloud environments and build data pipelines using Azure Synapse, ADF, Databricks, and Spark
Our transportation client is seeking a Cloud Data Engineer (5+ years) to configure cloud environments and build data pipelines using Azure Synapse, ADF, Databricks, and Spark
Join a transportation organization supporting a large-scale ITSM Replacement Program within its Business Technology Services division. This role focuses on configuring cloud environments, updating Synapse pipelines, supporting QA and UAT activities, and deploying production data processes within the Azure data ecosystem. The position works closely with Cloud Data Architects, Scrum teams, and business stakeholders on data solutions and analytics initiatives.
5 month Contract, high chance of extension, Vancouver, Tuesday and Wednesday onsite Hybrid, Working Hours: 37.5 PST
Must Haves
- 5+ years on Cloud implementation projects within the Azure data ecosystem
- Hands‑on expertise with ADF, Azure Databricks, Delta Lake, Azure Data Lake Storage, Azure Synapse, and Power BI
- Strong experience converting Synapse pipelines to ADF and Databricks
- Hands‑on development using Spark, PySpark, and Python in Azure
- Diploma in computer science from a recognized institute of technology including courses in database design, programming, business and systems analysis
Nice to Have
- Experience working in Scrum Agile
- Data management and data quality
- Experience gathering and analyzing functional and technical requirements
- Experience with Crystal Report
Responsibilities
- Set up and configure the cloud environment
- Change Synapse pipelines to pull data into the parallel run environment
- Unit test code changes
- Support testing and QA of data loaded into the parallel run environment
- Deploy code into production and schedule periodic data processes
- Create automated testing using the Test Automated Framework
Our transportation client is seeking a Cloud Data Engineer (5+ years) to configure cloud environments and build data pipelines using Azure Synapse, ADF, Databricks, and Spark
Join a transportation organization supporting a large-scale ITSM Replacement Program within its Business Technology Services division. This role focuses on configuring cloud environments, updating Synapse pipelines, supporting QA and UAT activities, and deploying production data processes within the Azure data ecosystem. The position works closely with Cloud Data Architects, Scrum teams, and business stakeholders on data solutions and analytics initiatives.
5 month Contract, high chance of extension, Vancouver, Tuesday and Wednesday onsite Hybrid, Working Hours: 37.5 PST
Must Haves
- 5+ years on Cloud implementation projects within the Azure data ecosystem
- Hands‑on expertise with ADF, Azure Databricks, Delta Lake, Azure Data Lake Storage, Azure Synapse, and Power BI
- Strong experience converting Synapse pipelines to ADF and Databricks
- Hands‑on development using Spark, PySpark, and Python in Azure
- Diploma in computer science from a recognized institute of technology including courses in database design, programming, business and systems analysis
Nice to Have
- Experience working in Scrum Agile
- Data management and data quality
- Experience gathering and analyzing functional and technical requirements
- Experience designing Data Lakes
- Experience with Crystal Report
Responsibilities
- Set up and configure the cloud environment
- Change Synapse pipelines to pull data into the parallel run environment
- Unit test code changes
- Support testing and QA of data loaded into the parallel run environment
- Prepare deployment plans for production implementation
- Deploy code into production and schedule periodic data processes
- Create automated testing using the Test Automated Framework
Disclaimer: AI may be used in evaluating candidates. This posting is for an existing vacancy.