Lead Data Engineer
Summary
Lead a data engineering team in Stellenbosch (hybrid), designing and maintaining scalable data pipelines, warehouses, and ETL/ELT processes while mentoring junior engineers and owning data governance. Core stack: SQL, Python, big-data frameworks (Spark/Hadoop), and cloud data platforms such as AWS, Azure, or GCP.
About the Role
Our client is seeking an experienced and strategic Lead Data Engineer to join their growing analytics division in Stellenbosch . This role is critical for designing, building, and maintaining scalable data pipelines and infrastructure that support our organization's data-driven initiatives. You will lead a team of data engineers, mentor junior members, and ensure the reliability, efficiency, and performance of our data systems. This is an exceptional opportunity to influence data strategy, work with advanced technologies, and contribute to a company that prioritizes data integrity and innovation in the heart of Stellenbosch .
Key Responsibilities
- Design, construct, install, and maintain highly scalable data pipelines and data warehousing solutions.
- Lead and mentor a team of data engineers, overseeing project execution and ensuring quality standards.
- Develop and optimize ETL/ELT processes to ingest, transform, and load data from various sources.
- Implement robust data governance, quality, and security measures across all data platforms.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver effective solutions.
- Evaluate and implement new data technologies and methodologies to improve data infrastructure.
Requirements
- Master's degree in Computer Science, Engineering, or a related quantitative field.
- 7+ years of experience in data engineering, with at least 2 years in a lead or senior capacity.
- Expertise in SQL, Python, and data processing frameworks (e.g., Apache Spark, Hadoop).
- Proven experience with cloud data platforms (e.g., AWS Redshift/S3/Glue, Azure Data Lake/Databricks, GCP BigQuery/Dataflow).
- Strong understanding of data modeling, data warehousing concepts, and database design.
- Excellent leadership, communication, and problem-solving skills are essential.
Benefits
- Competitive salary commensurate with experience, plus performance bonuses.
- Comprehensive health insurance and retirement planning.
- Significant opportunities for professional growth and development.
- A hybrid work model providing flexibility and work-life balance.
- Collaborative team environment with access to leading data technologies in Stellenbosch.