Data Engineer
Summary
Design, build, and maintain scalable data pipelines and infrastructure for a client team based in Nelspruit, South Africa, in a hybrid work setting. Day to day involves ETL/ELT development, data quality monitoring, cloud data warehousing, and partnering with data scientists and analysts using SQL and big data tools like Spark, Hadoop, and Kafka.
About the Role
Our client is seeking a skilled and dedicated Data Engineer to join their growing team, contributing to projects based in Nelspruit . This role is essential for designing, building, and maintaining scalable data pipelines and infrastructure that enable data-driven insights. You will work closely with data scientists and analysts to ensure the availability, reliability, and efficiency of our data systems. This is an excellent opportunity for a professional looking to enhance data accessibility and performance in a collaborative, hybrid work setting.
Key Responsibilities
- Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
- Develop processes and tools to monitor data quality, ensuring accuracy and consistency.
- Build and optimize ETL/ELT processes for efficient data ingestion and transformation.
- Work with cloud-based data warehousing solutions and big data technologies.
- Collaborate with data scientists and analysts to understand their data needs and provide solutions.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- 3+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, Snowflake).
- Experience with big data technologies like Spark, Hadoop, or Kafka.
- Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
Benefits
- Competitive annual salary and bonus structure.
- Comprehensive medical, dental, and vision insurance.
- Flexible hybrid work arrangements, balancing remote and office time in Nelspruit .
- Support for professional development and continuous learning.
- A dynamic and collaborative team environment.