Lead Data Engineer: Big Data Platform Architect
Summary
Placements24 seeks a Principal/Lead Data Engineer in Soweto, South Africa to architect and maintain scalable big data infrastructure for analytics and ML initiatives. Day to day involves building high-performance data pipelines, warehouses, and lakes with Spark, Hadoop, and Flink, while mentoring juniors and evaluating new technologies.
Placements24 in Soweto, Gauteng seeks a Principal Data Engineer to design, build, and maintain scalable big data infrastructure supporting analytics and ML initiatives.
You will lead the development of high-performance data pipelines, data warehouses, and data lakes, utilizing Spark, Hadoop, and Flink, while ensuring data quality, security, and governance. Collaboration with data scientists and engineers is essential, with mentorship of juniors and technology evaluation included.