Data Engineer
Posted 1
view
Summary
A data engineer in Cape Town who designs, builds and maintains scalable data platforms and ETL pipelines for financial data analytics, working with data architects and finance/IT stakeholders. Core stack: SQL, Python, AWS cloud data services and Snowflake, with CI/CD and infrastructure-as-code practices.
Purpose Statement
To design, build and maintain robust, scalable and efficient data platforms and infrastructure that powers data-driven decision-making across the organisation. You'll analyse business and system requirements, contribute to solution design documentation alongside Data Architects and build the pipelines that keep financial data flowing reliably and efficiently.
Education (Minimum)
- Grade 12 National Certificate / Vocational
- Bachelor's Degree in Information Technology - Computer Science or Information Technology
- Honours Degree in Information Technology - Computer Science or Information Technology
Knowledge:
- Advanced SQL modelling principles and query optimisation
- Snowflake practical working experience is key; deep expertise is not required
- Deep knowledge of AWS cloud data services
- Batch processing concepts and basic stream processing
- ETL pipeline design, including error handling and recovery mechanisms
- Data lake and data warehouse patterns
- Data quality and governance implementation
- CI/CD principles and version control
- Infrastructure as code and workflow orchestration tools
- 5 years in data engineering or a closely related field
- Experience leading or contributing to data engineering projects
- Strong SQL and Python skills
- Hands-on experience with AWS and Snowflake
- Experience building and optimising data pipelines for financial data analytics
- Experience working with cross-functional teams finance, IT to understand business needs and deliver data-driven solutions, including communicating technical progress to non-technical stakeholders
- Understanding of financial products and services
- Clear criminal and credit record