Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Placements24

NewBe an early applicant

Principal Data Engineer

Posted

Summary

Principal Data Engineer joining a leading financial services institution's advanced analytics division in Stellenbosch (hybrid). Day to day: architect, build, and optimize scalable batch and real-time data pipelines and cloud data warehouses/lakes using Spark, Kafka, SQL/NoSQL, and AWS/Azure/GCP, while mentoring engineers and driving data governance.

About the Role

Our client, a leading financial services institution, is seeking a highly experienced and visionary Principal Data Engineer to join their advanced analytics division. This hybrid role is based in the vibrant tech hub of Stellenbosch, Western Cape. You will be responsible for architecting, building, and optimizing our client's data pipelines and infrastructure, enabling sophisticated data analysis and machine learning initiatives. As a Principal Engineer, you will provide technical leadership, mentor junior team members, and drive innovation in data architecture and processing. The ideal candidate possesses a deep understanding of big data technologies, cloud platforms, and data warehousing principles, coupled with a strong commitment to data quality and governance.

Key Responsibilities
  • Design, develop, and maintain scalable and robust data pipelines for batch and real-time data processing.
  • Architect and implement data warehousing solutions and data lakes on cloud platforms (e.g., AWS, Azure, GCP).
  • Optimize data processing workflows for performance, cost, and reliability using big data technologies like Spark, Hadoop, and Kafka.
  • Develop and enforce data governance policies and standards to ensure data quality, security, and compliance.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver tailored solutions.
  • Implement data modeling techniques to support business intelligence and analytical reporting needs.
  • Troubleshoot and resolve complex data infrastructure issues.
  • Provide technical leadership and mentorship to a team of data engineers.
  • Evaluate and recommend new technologies and tools to enhance data infrastructure capabilities.
  • Ensure the scalability and efficiency of data storage and processing solutions.
Requirements
  • Master's or Ph. D. in Computer Science, Engineering, Mathematics, or a related quantitative field.
  • 10+ years of experience in data engineering, with a significant focus on building and managing large-scale data platforms.
  • Minimum of 5 years of experience in a lead or principal engineering role.
  • Extensive experience with cloud data services (e.g., AWS Redshift/S3/EMR, Azure Data Factory/Synapse, GCP Big Query/Dataflow).
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Deep understanding of distributed systems and big data technologies (Spark, Hadoop ecosystem).
  • Strong experience with SQL and No SQL databases.
  • Expertise in data warehousing concepts, ETL/ELT processes, and data modeling.
  • Experience with data streaming technologies (e.g., Kafka, Kinesis) is highly desirable.
  • Excellent leadership, communication, and problem-solving skills.
  • Ability to work effectively in a hybrid work environment.
Benefits

Our client offers an industry-leading salary, attractive bonuses, and a comprehensive benefits package including health insurance, retirement contributions, and life assurance. Employees benefit from generous professional development budgets, opportunities to attend leading conferences, and a collaborative work environment within our modern Stellenbosch office. This role offers a unique opportunity to shape the data landscape of a major financial institution and drive significant business impact.

Skills

What Principal Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →