Databricks Production Data Pipeline Architect
Summary
A hands-on Databricks consultant in Cape Town designs, builds and optimises production lakehouse data pipelines — developing PySpark and Spark SQL transformations, Delta Lake tables, data quality checks, and workflow orchestration with CI/CD, focused on reliability, speed and cost efficiency.
Sabenza IT & Recruitment in Cape Town is seeking a hands-on Databricks Consultant to design, build and optimise production lakehouse pipelines on the Databricks platform. You will work across ingestion, transformation and delivery of curated data, focusing on reliability, speed and cost efficiency.
Key tasks include developing PySpark and Spark SQL transformations, building Delta Lake tables, implementing data quality checks, and maintaining workflow orchestration and CI/CD practices.
Skills
Sign in to read and join the discussion.