AI/ML Data Engineer
Summary
An AI/ML Data Engineer joins the client's advanced analytics team in Randburg to design, build, and maintain scalable data pipelines (ETL/ELT) and data infrastructure that feed AI/ML models, ensuring data quality for data scientists and ML engineers. Core stack: SQL, Spark/Hadoop, cloud data platforms (AWS/Azure/GCP), and Python or Scala.
About the Role
Our client is seeking a skilled AI/ML Data Engineer to join their advanced analytics team in Randburg . This role is crucial for building and optimizing robust data pipelines that feed into AI and machine learning models. You will work with large, complex datasets, ensuring data quality, accessibility, and efficiency for data scientists and ML engineers. The goal is to create a scalable data infrastructure that supports the rapid development and deployment of predictive models and intelligent applications, fostering a culture of data excellence and enabling the organization to leverage data more effectively for strategic decision-making and innovative AI-driven solutions.
Key Responsibilities
- Design, construct, install, test, and maintain highly scalable data management systems.
- Develop and manage ETL/ELT pipelines for AI/ML model training and production.
- Ensure data quality, integrity, and availability for various data consumers.
- Collaborate with data scientists and ML engineers to understand data requirements and deliver solutions.
- Optimize data storage and processing for performance and cost-efficiency.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- Proven experience as a Data Engineer, with a focus on supporting AI/ML initiatives.
- Strong proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop).
- Experience with cloud data platforms (AWS, Azure, GCP) and data warehousing solutions.
- Proficiency in at least one programming language like Python or Scala.
Benefits
- Competitive salary and comprehensive benefits package.
- Opportunity to work with cutting-edge AI and big data technologies.
- Collaborative and supportive team environment.
- Professional development and training programs.
- Centrally located office in Randburg .