Data Engineer/Developer - Azure/Python
Posted Updated
Description
2iSolutions Inc. in Oshawa is seeking a Senior Data Engineer/Developer with deep Microsoft technologies expertise for a 3-year contract. The role is hybrid, three days on-site in Oshawa, with opportunities to shape data architecture and build scalable pipelines.
The candidate will participate in architecture/design forums, define solutions and standards, and personally implement and optimize them, across Azure data services and large-scale data environments.
8+ years hands-on data engineering/development experience. Strong SQL and Python with production-grade data pipelines. Strong Spark/PySpark experience with large-scale datasets and distributed workloads. Deep experience designing ETL/ELT architectures including ingestion, transformation, monitoring and data quality. Strong data architecture experience including dimensional modeling and data lake/lakehouse design. Significant hands-on experience with Azure data technologies (Azure Data Factory, Databricks, ADLS, Synapse/Fabric). Experience making architecture decisions and trade-offs beyond following a provided design. Practical understanding of data strategy: governance, ownership, metadata, data quality, security, scalability. Experience defining reusable patterns for ingestion, transformation, CI/CD, monitoring and data quality. Ability to troubleshoot and optimize production workloads (SQL, Spark, pipelines).Skills
Sign in to read and join the discussion.