Data Engineer
Summary
Data Engineer building and maintaining scalable ETL/ELT pipelines, data warehouses, and data lakes for a data analytics firm, ensuring data quality and supporting data science and analytics teams. Core stack includes SQL, relational databases, Python/Scala, and cloud data platforms (AWS, Azure, GCP) in a hybrid Upington-based role.
About the Role
Our client, a fast-paced data analytics firm, is seeking a skilled Data Engineer to join their growing team in Upington, Northern Cape . This role is essential for building and maintaining scalable data pipelines and infrastructure that support our data science and analytics initiatives. You will be responsible for data extraction, transformation, loading (ETL), data warehousing, and ensuring the availability and quality of data across the organization. This is a hybrid role, offering a blend of remote work flexibility and on-site collaboration at our Upington office. The ideal candidate possesses strong technical skills in data processing and a passion for building robust data solutions.
Key Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines.
- Develop and manage data warehouses and data lakes.
- Ensure data quality, integrity, and reliability.
- Optimize data retrieval and processing performance.
- Collaborate with data scientists and analysts to understand data needs.
- Implement data governance and security best practices.
- Automate data processes and monitoring.
- Work with various data sources, including databases, APIs, and flat files.
- Evaluate and recommend new data technologies and tools.
- Troubleshoot data-related issues and resolve them efficiently.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- 3+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
- Experience with big data technologies (e.g., Spark, Hadoop) is a plus.
- Familiarity with cloud data platforms (AWS, Azure, GCP).
- Knowledge of ETL/ELT tools and processes.
- Proficiency in at least one programming language like Python or Scala.
- Understanding of data modeling techniques.
- Strong analytical and problem-solving skills.
- Good communication and teamwork abilities.
Benefits
- Competitive salary and performance bonuses.
- Comprehensive medical aid benefits.
- Opportunities for professional development and training.
- Hybrid work arrangement offering flexibility.
- Exposure to diverse data challenges in the Upington, Northern Cape region.
- A collaborative and supportive work environment.
- Generous annual leave.