Data engineer - ai platform
Summary
Data engineer building and maintaining the core data infrastructure for an AI platform in Mossel Bay: designing scalable ETL/ELT pipelines, data warehouses and data lakes, and optimizing database performance in collaboration with AI researchers and ML engineers. Core stack: SQL, Python/Scala/Java, Spark/Hadoop/Kafka, and AWS/Azure/GCP.
Our client is seeking a talented and motivated Data Engineer to build and maintain the core data infrastructure for their AI Platform in Mossel Bay. This role is essential for enabling the development and deployment of advanced AI models by ensuring data is accessible, reliable, and optimized. You will work closely with AI researchers, machine learning engineers, and data scientists to design and implement scalable data pipelines, data warehouses, and data lakes. This is an excellent opportunity for a data professional who enjoys tackling challenging data problems and contributing to the success of cutting‑edge AI initiatives.
Key Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Build robust ETL/ELT pipelines to ingest and transform data from various sources for AI/ML use cases. Develop and manage data warehouses and data lakes, ensuring data quality and integrity. Optimize data architecture and database performance for efficient querying and analysis. Collaborate with data scientists and ML engineers to understand their data needs and provide appropriate solutions. Requirements Bachelor's degree in Computer Science, Engineering, or a related quantitative field. 3+ years of experience in data engineering or a similar role. Strong proficiency in SQL and experience with at least one programming language (e.g., Python, Scala, Java). Hands‑on experience with big data technologies (e.g., Spark, Hadoop, Kafka) and cloud data services (AWS, Azure, GCP). Familiarity with data warehousing concepts and database design principles. Benefits Competitive salary and comprehensive benefits package. Opportunity to work with modern data stack and advanced AI technologies in Mossel Bay. Professional development and training opportunities. Supportive team environment focused on innovation. Flexible work arrangements to promote work-life balance.