Data Engineer/Developer - Azure/Python
Summary
Senior Data Engineer/Developer on a 3-year contract (hybrid, 3 days/week on-site in Oshawa) who designs and personally builds production-grade data pipelines and lakehouse architecture on the Microsoft Azure stack: SQL, Python, Spark/PySpark, Azure Data Factory, Databricks, ADLS, and Synapse/Fabric, plus governance and reusable framework design.
Our Client in Oshawa is looking to hire a Senior Data Engineer/Developer with deep experience with Microsoft Technologies. This is a 3 year contract roles - hybrid 3 days/week on-site in Oshawa.
We are looking for candidates who can participate in architecture/design forums, define the right solution and standards, and then personally build, troubleshoot, and optimize that solution.
- 8+ years of hands-on data engineering/development experience, ideally with recent hands-on coding.
- Strong SQL and Python, with practical experience building complex production-grade data pipelines.
- Strong Spark/PySpark experience processing large-scale datasets and optimizing distributed workloads.
- Deep experience designing ETL/ELT architectures, including ingestion, transformation, orchestration, error handling, monitoring, and data quality.
- Strong data architecture experience, including dimensional modeling, data lake/lakehouse design, integration patterns, and designing solutions across multiple source systems.
- Significant hands-on experience with Azure data technologies, ideally Azure Data Factory, Azure Databricks, ADLS, Synapse/Fabric, or equivalent.
- Experience making architecture decisions and trade-offs, not simply implementing designs provided by an architect.
- Practical understanding of data strategy, including governance, data ownership, metadata/cataloguing, data quality, security, scalability, and platform standards.
- Experience defining reusable patterns/frameworks for ingestion, transformation, CI/CD, monitoring, and data quality rather than building one-off pipelines.
- Ability to troubleshoot and optimize production workloads, including SQL performance, Spark jobs, pipeline failures, and large-volume processing.
Please reach out to discuss the position further.....
Skills
Sign in to read and join the discussion.