Databricks Data Engineer Toronto
Summary
Contract Databricks data engineer in Toronto building ingestion, transformation, and ETL pipelines across Bronze/Silver/Gold medallion layers for an enterprise data hub initiative, including migrating workloads from Hive Metastore. Core stack: Databricks, SQL, Python, PySpark, Azure Data Factory, Unity Catalog.
Build Databricks pipelines in Toronto using SQL, Python, and PySpark for enterprise data migration and centralization. This contract role supports a data hub initiative.
Apex Systems seeks a Databricks Data Engineer to develop and maintain ingestion, transformation, and ETL pipelines. You will work across Bronze, Silver, and Gold layers within a medallion architecture, supporting Azure Data Factory and Unity Catalog environments. The work includes migrating workloads from Hive Metastore.
Key Responsibilities:
- Design and maintain Databricks data pipelines
- Build Bronze, Silver, and Gold processing layers
- Ingest and transform enterprise source data
- Develop curated datasets and downstream data feeds
- Troubleshoot migration pipelines and transformation issues
Requirements:
- Strong Databricks data engineering experience
- Strong SQL, Python, and PySpark development skills
- Experience designing ETL, ELT, and ingestion pipelines
- Hands-on Azure Data Factory experience
- Experience with relational or file-based sources
Apply Databricks, SQL, PySpark, and migration expertise to enterprise data engineering in Toronto with Apex Systems.