Senior Data Engineer
Summary
Senior Data Engineer on a client's data platform team, designing and maintaining scalable ETL/ELT pipelines, data warehouses and cloud data infrastructure (AWS Redshift, Snowflake, BigQuery) to support analytics and machine learning. Fully remote role based out of Mahikeng, South Africa.
About the Role
Our client is seeking an experienced Senior Data Engineer to join their growing data platform team in Mahikeng . This role is critical for designing, building, and maintaining robust data pipelines and infrastructure that support the organization's data analytics and machine learning initiatives. You will work with large-scale datasets, ensuring data quality, reliability, and accessibility. The ideal candidate is proficient in data warehousing, ETL processes, and cloud-based data solutions, with a passion for enabling data-driven insights.
Key Responsibilities
- Design, build, and optimize scalable ETL/ELT pipelines for ingesting and transforming data from various sources.
- Develop and maintain data warehouses and data lakes using cloud technologies (e.g., AWS Redshift , Snowflake , BigQuery ).
- Ensure data quality, integrity, and consistency across all data platforms.
- Collaborate with data scientists and analysts to understand their data needs and provide efficient data solutions.
- Implement data governance and security best practices.
- Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering or a related role.
- Strong proficiency in SQL and experience with relational and NoSQL databases.
- Expertise in programming languages such as Python or Scala for data manipulation and pipeline development.
- Hands-on experience with cloud data platforms and big data technologies (e.g., Spark, Hadoop).
- Experience with ETL tools and data warehousing concepts.
Benefits
- Competitive salary and annual bonus structure.
- Comprehensive health, dental, and vision coverage.
- Retirement savings plan with employer matching.
- Opportunities for professional development and training in data technologies.
- A fully remote work environment, offering maximum flexibility, based out of Mahikeng .
- Work on challenging projects involving big data and cutting-edge analytics tools.