Senior Data Engineer
Summary
Senior Data Engineer designing, building, and maintaining ETL/ELT pipelines, data warehouses, and data lakes to power analytics and business intelligence for the client's Stellenbosch-based team. Core stack: SQL, Python/Scala, Spark/Hadoop, and cloud data platforms like AWS Redshift, Azure Data Lake, and GCP BigQuery.
About the Role
Our client is seeking a seasoned Senior Data Engineer to join their analytics team in Stellenbosch. This hybrid role is essential for designing, building, and maintaining our data infrastructure, ensuring reliable and efficient data pipelines for analytics and business intelligence. You will work with large volumes of data, implementing robust ETL/ELT processes and optimizing data warehousing solutions. Collaborating with data scientists and analysts, you will enable data-driven decision-making across the organization. This is an excellent opportunity to shape data strategy and contribute to a data-centric culture within a renowned institution.
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines to ingest and transform data from diverse sources.
- Build and maintain data warehouses and data lakes using modern technologies.
- Ensure data quality, integrity, and availability across all data systems.
- Collaborate with data scientists and analysts to understand their data needs and provide efficient access.
- Implement data governance and security best practices.
- Automate data processes and monitor pipeline performance for efficiency and reliability.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering, ETL development, or a similar role.
- Strong proficiency in SQL and experience with relational and NoSQL databases.
- Hands-on experience with big data technologies (e.g., Spark, Hadoop) and cloud data platforms (AWS Redshift, Azure Data Lake, GCP BigQuery).
- Proficiency in programming languages like Python or Scala for data manipulation and pipeline development.
- Experience with data warehousing concepts and dimensional modeling.
Benefits
- Competitive annual salary with performance-related bonuses.
- Hybrid work model providing flexibility with a base in Stellenbosch.
- Comprehensive health and wellness benefits package.
- Generous allocation for professional development and certifications.
- A collaborative environment focused on innovation and data excellence.
- Access to state-of-the-art data infrastructure and tools.