Data Engineer
Summary
Build and maintain a Python-based regulatory reporting platform that automates SARB returns using AWS, ETL pipelines, and data warehousing to replace manual spreadsheets.
Join a team at the forefront of regulatory reporting transformation. The team is building a strategic Regulatory Reporting Automation Platform that automates the preparation, validation, and submission of regulatory returns required by the South African Reserve Bank (SARB). This platform replaces manual, spreadsheet-driven processes with a scalable, Python-based solution that enhances data quality, auditability, and operational efficiency. As a Data Engineer, you will contribute to a modern data platform that combines software engineering, data engineering, cloud technologies, and configurable rules engines to process large volumes of financial data and transform it into regulator-ready outputs.
Job description:
About the team
Join a team at the forefront of regulatory reporting transformation. The team is building a strategic Regulatory Reporting Automation Platform that automates the preparation, validation, and submission of regulatory returns required by the South African Reserve Bank (SARB). This platform replaces manual, spreadsheet-driven processes with a scalable, Python-based solution that enhances data quality, auditability, and operational efficiency. As a Data Engineer, you will contribute to a modern data platform that combines software engineering, data engineering, cloud technologies, and configurable rules engines to process large volumes of financial data and transform it into regulator-ready outputs.
Purpose Statement
You will design, build and maintain robust, scalable and efficient data platforms, applications and infrastructure that power data-driven decision-making across the organisation. You'll analyse business and system requirements, contribute to solution design documentation alongside Data Architects and build the pipelines and applications that keep data flowing reliably and efficiently.
Education (Minimum)
- Grade 12 National Certificate / Vocational
- Bachelor's Degree in Information Technology - Computer Science or Information Technology
Education (Ideal or Preferred)
- Honours Degree in Information Technology - Computer Science or Information Technology
Knowledge and Experience
Knowledge:
- Advanced Python — the core technical requirement for this role
- Strong SQL — modelling principles and query optimisation
- Deep knowledge of AWS cloud data services
- Application development and API design — Django or a similar backend framework is advantageous
- Kubernetes and containerised data solutions
- Batch processing concepts and basic stream processing
- ETL pipeline design, including error handling and recovery mechanisms
- Data lake and data warehouse patterns
- Data quality and governance implementation
- CI/CD principles, version control and automated testing
- Infrastructure as code and workflow orchestration tool
Experience:
- 5 years in data engineering or a closely related field — what counts is direct involvement in solution implementation and integration
- Experience leading or significantly contributing to data engineering projects
- Strong, hands‑on Python and AWS experience
- Backend application development experience — Django or similar frameworks;
- API development experience
- Experience working with cross‑functional teams — finance, IT, business analysts — to understand business needs and deliver data‑driven solutions, including communicating technical progress to non‑technical stakeholders
- Snowflake experience is an advantage
Additional Information
- Clear criminal and credit record
Profile description
Join a team at the forefront of regulatory reporting transformation. The team is building a strategic Regulatory Reporting Automation Platform that automates the preparation, validation, and submission of regulatory returns required by the South African Reserve Bank (SARB). This platform replaces manual, spreadsheet driven processes with a scalable, Python-based solution that enhances data quality, auditability, and operational efficiency. As a Data Engineer, you will contribute to a modern data platform that combines software engineering, data engineering, cloud technologies, and configurable rules engines to process large volumes of financial data and transform it into regulator-ready outputs