Senior AI Data Engineer
Summary
A senior data engineer who designs, builds, and maintains scalable ETL/ELT pipelines, data warehouses, and data lakes to support AI/ML model training, working closely with data scientists and ML engineers. Core tech includes SQL, Spark/Hadoop/Kafka, cloud data platforms (AWS, Azure, or GCP), and Python or Scala.
About the Role
Our client is looking for a seasoned Senior AI Data Engineer to join their rapidly expanding data science division in Kimberley . You will be instrumental in designing, building, and maintaining scalable data pipelines and infrastructure that power their advanced AI and machine learning initiatives. This role demands expertise in data warehousing, ETL processes, and big data technologies, ensuring that high-quality, accessible data is available for model training and analysis. You will work closely with AI researchers and engineers to architect data solutions that drive impactful business outcomes in Kimberley .
Key Responsibilities
- Design, develop, and maintain robust, scalable, and efficient ETL/ELT data pipelines for AI/ML workloads.
- Manage and optimize large datasets, data warehouses, and data lakes.
- Implement data quality checks, data governance policies, and data security measures.
- Collaborate with data scientists and ML engineers to understand data requirements and provide necessary data access.
- Develop monitoring and alerting systems for data pipelines and data quality.
Requirements
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related quantitative field.
- 5+ years of experience in data engineering, with a focus on supporting AI and machine learning projects .
- Strong proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop, Kafka).
- Experience with cloud data platforms (e.g., AWS Redshift/S3/EMR, Azure Data Factory/Synapse, GCP BigQuery/Dataproc).
- Proficiency in at least one programming language such as Python or Scala.
Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive medical, dental, and vision insurance.
- Opportunities for professional growth and continuous learning in Kimberley .
- Access to cutting-edge data infrastructure and technologies.
- A collaborative team environment focused on data-driven innovation.