Data Engineer - AI/ML Focus
Summary
A data engineer builds and maintains scalable data pipelines supporting AI/ML model development for the employer's client, ensuring data quality and optimizing cloud data infrastructure. Core tech includes SQL, big data tools (Spark, Hadoop), cloud data services (AWS, Azure, GCP), and Python or Scala, in a hybrid work setup.
About the Role
Our client is looking for a skilled Data Engineer with a specialization in AI/ML to join their growing team in Welkom. You will be responsible for designing, building, and maintaining robust data pipelines that support the development and deployment of machine learning models. This role involves working with large, complex datasets, ensuring data quality, and optimizing data infrastructure for performance and scalability. Your contributions will be crucial in enabling our data science teams to build cutting-edge AI solutions, operating within a flexible hybrid work model.
Key Responsibilities
- Design, construct, install, and maintain scalable data pipelines for AI/ML applications.
- Develop processes for data acquisition, cleansing, transformation, and aggregation.
- Ensure data accuracy, integrity, and efficiency for analytical and modeling purposes.
- Collaborate with data scientists and ML engineers to understand data requirements.
- Optimize data infrastructure for performance and cost-effectiveness.
- Implement data security and governance best practices.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience as a Data Engineer, with a focus on AI/ML projects.
- Proficiency in SQL and experience with big data technologies (e.g., Spark, Hadoop).
- Experience with cloud data services (e.g., AWS S3, Azure Data Lake, GCP Cloud Storage).
- Familiarity with machine learning workflows and data modeling techniques.
- Strong programming skills in Python or Scala.
Benefits
- Competitive salary package.
- Hybrid work arrangement for work-life balance.
- Comprehensive health and wellness benefits.
- Opportunities for career advancement and skill development.
- A collaborative environment focused on innovation in Welkom.