Data Engineer - Azure/Databricks
Summary
Builds and maintains Azure-based data pipelines and lakehouse/warehouse solutions using Databricks, PySpark, and Microsoft data stack to power analytics and applications.
Our Client in Oshawa is looking to hire 2 Data Engineers with deep experience as a Data Engineer with Microsoft Technologies. These positions are 1 year contract roles - hybrid 2 days/week on-site in Oshawa.
Job Overview
- As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.
- Will be working as part of a cross-discipline agile team who help each other solve problems across all business areas.
- Will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.
- Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.
Qualifications
- Experience as a Data Engineer designing and building data pipelines.
- Fluent in creating data processing frameworks using Python, PySpark, SparkSOL and SOLExperience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
- Experience building data pipelines for Data Lakehouses and Data Warehouses
- Good understanding of data structures and data processing frameworks
- Knowledge of data governance and data quality principles
Please reach out to discuss the position further.....