Senior/lead data engineer
Summary
Lead a team to design and build scalable cloud data pipelines and warehouses using Python, PySpark, AWS, and SQL, ensuring data quality and governance for a retail/FMCG client.
Cape Town, South Africa | Posted on 03/08/2026
Our client is looking for an experienced Senior / Lead Data Engineer to join their growing Data Engineering team. This role is responsible for designing and delivering scalable cloud-based data solutions, leading technical initiatives, and mentoring engineers while driving best practices across enterprise data platforms.
Requirements Key Responsibilities
Design, build and optimise enterprise data pipelines and data platforms. Develop scalable cloud-native data engineering solutions. Collaborate with business and technical stakeholders to deliver data-driven solutions. Define and maintain data architecture and engineering standards. Drive Dev Sec Ops and CI/CD best practices. Mentor and coach Data Engineers. Ensure data quality, governance and platform reliability. Participate in Agile ceremonies and technical planning. Drive continuous improvement and innovation across the data environment.
Requirements
Bachelor's Degree or Diploma in Computer Science, Engineering, Mathematics, Information Systems or similar. 8+ years' experience in Data Engineering or Software Engineering. Strong experience with Business Intelligence and Data Warehousing. Advanced SQL skills. Expert knowledge of Python and Py Spark. Experience with Hadoop and Apache Spark. Strong AWS experience, including EMR, S3, Athena, RDS, Lambda and API Gateway. Good understanding of SDLC, Solution Architecture and Dev Sec Ops. Experience with Azure, Google Cloud Platform and Snowflake is advantageous. Previous experience leading or mentoring engineering teams. Retail or FMCG industry experience is essential.
#J-18808-Ljbffr