Databricks Data Engineer | Azure, PySpark & CDC Pipelines
Summary
Databricks Data Engineer (Canada) designing, building, and optimizing end-to-end data pipelines on Azure for retail datasets. Day-to-day work centers on PySpark, SQL, and Kafka streaming, with CDC-based pipelines, data quality checks, and CI/CD delivery to production; Delta Lake and data modeling are a plus.
V-Soft Consulting Group, Inc. is seeking a Databricks Data Engineer to design, build, and optimize end-to-end data pipelines in an Azure environment. The role emphasizes PySpark, SQL, and Kafka streaming to deliver reliable data solutions for retail datasets.
You will implement CDC-based pipelines, ensure data quality, and collaborate across teams to move from development to production with CI/CD practices. Familiarity with Delta Lake and data modeling is a plus.