Senior Data Engineer - Big Data Platforms

Our client, a leader in AI & Emerging Technologies, is seeking a highly skilled Senior Data Engineer to join their innovative team in Stellenbosch, Western Cape. This role is central to designing, building, and maintaining robust, scalable data pipelines and infrastructure that power our advanced analytics and AI initiatives. You will work with cutting-edge big data technologies to ensure the seamless flow and availability of data. This hybrid position offers a blend of in-office collaboration and remote flexibility, allowing you to leverage your expertise effectively in a dynamic work environment. You will play a key role in shaping our data architecture and enabling data-driven insights.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop and optimize ETL/ELT processes for large volumes of structured and unstructured data.
• Build and maintain data lakes, data warehouses, and other data storage solutions.
• Collaborate with data scientists, analysts, and application developers to understand their data needs and provide solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Implement monitoring and alerting systems for data pipelines and infrastructure.
• Evaluate and recommend new technologies and tools to enhance data capabilities.
• Mentor junior data engineers and contribute to establishing best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering, with a proven track record in building and managing big data systems.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with distributed data processing frameworks (e.g., Spark, Hadoop).
• Hands‑on experience with cloud data platforms (AWS, Azure, GCP) and their associated services (e.g., S3, Redshift, BigQuery, Data Factory).
• Expertise in SQL and experience with various database technologies (relational and NoSQL).
• Familiarity with data warehousing concepts and dimensional modeling.
• Knowledge of data governance, data quality, and data security best practices.
• Excellent problem-solving skills and attention to detail.

Benefits

Our client offers a competitive salary, performance bonuses, and comprehensive benefits including health, retirement, and generous paid time off. We are committed to employee growth, providing opportunities for advanced training, certifications, and attending industry conferences. The hybrid work model in Stellenbosch, Western Cape allows for a balanced approach to work and personal life. You will be part of a forward-thinking organization where your contributions directly impact the development of innovative AI solutions and data-driven strategies.