Data Engineer - AI Platforms

About the Role

Our client is seeking a skilled Data Engineer to join their team, focusing on building and maintaining robust data platforms that power their artificial intelligence initiatives in Upington . You will be responsible for designing, developing, and optimizing data pipelines that ingest, transform, and store large volumes of data required for machine learning and analytics. This role is critical for ensuring data availability, quality, and accessibility for our data science and AI teams, enabling them to build and deploy cutting-edge solutions.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and optimize data pipelines for efficient data extraction, transformation, and loading (ETL).
• Collaborate with data scientists and AI engineers to understand their data needs and provide reliable data solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Implement data warehousing solutions and data lakes to support analytical and AI workloads.
• Monitor and troubleshoot data infrastructure to ensure optimal performance and availability.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3-5 years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong programming skills in Python or Scala.
• Experience with big data technologies such as Spark, Hadoop, or similar frameworks.
• Familiarity with cloud data services (e.g., AWS Redshift, S3, Azure Data Lake, Google BigQuery).

Benefits

• Competitive salary and annual bonus opportunities.
• Comprehensive medical aid and retirement fund benefits.
• Opportunities for professional growth and learning new data technologies.
• A supportive team environment focused on data innovation.
• Generous paid time off and company holidays.