Data Engineer - Build Scalable Pipelines & Insights

About the Role Our client is a data-driven organization that leverages Artificial Intelligence to solve complex business challenges. We are seeking an experienced AI/ML Data Engineer to join our talented team in Randburg, Gauteng. This role is critical for building and maintaining the robust data pipelines and infrastructure necessary to support our machine learning initiatives. You will be responsible for collecting, cleaning, transforming, and managing large datasets to ensure they are readily available and optimally formatted for our data scientists and ML engineers. Our client is committed to fostering a collaborative and innovative environment where data is at the heart of decision-making. You will work with cutting-edge technologies and contribute to projects that have a significant impact across the business. The ideal candidate is passionate about data quality, efficiency, and possesses strong skills in data manipulation, ETL processes, and database management. We value individuals who are proactive, detail-oriented, and eager to contribute to the success of our AI and analytics endeavors. This position provides an excellent opportunity to grow your career in a dynamic and forward-thinking company.

Key Responsibilities

• Design, build, and maintain scalable data pipelines for AI and machine learning projects.
• Develop and implement ETL processes to extract, transform, and load data from various sources.
• Ensure data quality, integrity, and consistency across all data systems.
• Collaborate with data scientists and ML engineers to understand their data requirements.
• Optimize data storage and retrieval for performance and efficiency.
• Manage and maintain databases and data warehouses.
• Implement data governance and security best practices.
• Develop tools and scripts to automate data-related tasks.
• Monitor data pipeline performance and troubleshoot issues.
• Stay current with emerging data engineering technologies and best practices.

Requirements

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML workloads.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong experience with ETL tools and frameworks (e.g., Apache Spark, Pandas, Airflow).
• Experience in programming languages such as Python or Scala.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Understanding of data warehousing concepts and big data technologies.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.
• Experience with data modeling is a plus.

Benefits

• Competitive salary and comprehensive benefits package including medical, dental, and vision insurance.
• Performance bonuses awarded based on individual and company success.
• Opportunities for professional development including training and workshops.
• Ample paid time off.
• Retirement savings plan with company contributions.