Senior Data Engineer - Big Data Platforms
Summary
Senior Data Engineer at an AI/advanced-analytics company in Stellenbosch (hybrid): designs, builds, and maintains scalable data pipelines, ETL/ELT processes, data lakes and warehouses, plus monitoring, and mentors junior engineers. Core stack includes Python/Java/Scala, Spark/Hadoop, and cloud platforms like AWS, Azure, and GCP.
Our client, a leader in AI & Emerging Technologies, is seeking a highly skilled Senior Data Engineer to join their innovative team in Stellenbosch, Western Cape. This role is central to designing, building, and maintaining robust, scalable data pipelines and infrastructure that power our advanced analytics and AI initiatives. You will work with cutting-edge big data technologies to ensure the seamless flow and availability of data. This hybrid position offers a blend of in-office collaboration and remote flexibility, allowing you to leverage your expertise effectively in a dynamic work environment. You will play a key role in shaping our data architecture and enabling data-driven insights.
Key Responsibilities- Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
- Develop and optimize ETL/ELT processes for large volumes of structured and unstructured data.
- Build and maintain data lakes, data warehouses, and other data storage solutions.
- Collaborate with data scientists, analysts, and application developers to understand their data needs and provide solutions.
- Ensure data quality, integrity, and security across all data platforms.
- Implement monitoring and alerting systems for data pipelines and infrastructure.
- Evaluate and recommend new technologies and tools to enhance data capabilities.
- Mentor junior data engineers and contribute to establishing best practices.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering, with a proven track record in building and managing big data systems.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Extensive experience with distributed data processing frameworks (e.g., Spark, Hadoop).
- Hands‑on experience with cloud data platforms (AWS, Azure, GCP) and their associated services (e.g., S3, Redshift, Big Query, Data Factory).
- Expertise in SQL and experience with various database technologies (relational and No SQL).
- Familiarity with data warehousing concepts and dimensional modeling.
- Knowledge of data governance, data quality, and data security best practices.
- Excellent problem-solving skills and attention to detail.
Our client offers a competitive salary, performance bonuses, and comprehensive benefits including health, retirement, and generous paid time off. We are committed to employee growth, providing opportunities for advanced training, certifications, and attending industry conferences. The hybrid work model in Stellenbosch, Western Cape allows for a balanced approach to work and personal life. You will be part of a forward-thinking organization where your contributions directly impact the development of innovative AI solutions and data-driven strategies.
Skills
Sign in to read and join the discussion.