Data Engineer in Databricks at CPUS
Summary
A data engineer designs and builds scalable ELT/ETL pipelines and data lake/warehouse products on Azure Databricks, cleaning and optimizing datasets and supporting BI analysts with data modeling. Core stack is Python, SQL, and Spark in an agile, hybrid team based in Oshawa, Canada.
This role is essential for creating, supporting, and optimizing data lake and warehouse products. Working closely within an agile team, you'll leverage your expertise in Python, SQL, and Spark to solve complex data challenges. Your contributions will ensure data quality and enable impactful business intelligence reporting.
Key Responsibilities: • Design and implement scalable data ELT/ETL pipelines • Build reliable data lake and warehouse systems • Clean and optimize datasets for performance • Support Business Intelligence Analysts with data modeling • Collaborate with cross-functional teams on pipeline development
Requirements: • 4-6 years of experience as a Data Engineer • Strong skills in Python, SQL, and Spark • Experience with Azure Databricks and data integration • Knowledge of testing methodologies and agile practices • Familiarity with both SQL and NoSQL databases
Bring innovation and expertise in data engineering to enhance customer-centric experiences at CPUS Engineering.