Data Engineer
Summary
An Intermediate Data Engineer in Cape Town builds, maintains, and optimises production data pipelines and workflows using Databricks, Apache Spark, and PySpark, while developing CI/CD processes and ensuring data quality for a South African financial services and debt management organisation.
The business supports millions of customers through dataâdriven decisionâmaking, ethical financial practices, and technologyâled innovation. Data plays a central role in improving operational efficiency, customer outcomes, and regulatory compliance, and the engineering team works with modern platforms and strong development practices to support this mission.
This role is ideal for a Data Engineer with a solid foundation, who is eager to deepen their technical skills while working on meaningful, productionâgrade data solutions.
Responsibilities:
- Build, maintain, and optimise data pipelines and workflows using Databricks and Apache Spark
- Contribute to the endâtoâend design and implementation of data flows
- Develop and support CI/CD processes for data engineering workloads
- Ensure data quality, reliability, and performance across platforms
- Collaborate within Agile teams to deliver incremental, well-tested solutions
Requirements:
- 4-5 years' experience working as a Data Engineer
- Hands-on experience with Databricks
- Strong background in Apache Spark and cluster computing
- Solid Python skills, with mandatory PySpark experience
- Experience developing and maintaining CI/CD pipelines
Apply now!