Senior Data Engineer – Databricks & SAP Migration

About the Role

A large South African retailer is migrating from an on-premises data estate to Databricks, building a governed modern data platform using Medallion Architecture and Data Vault modelling. They need a Senior Data Engineer who can drive this migration technically, engage stakeholders up to C-suite level, and bring Finance and Economics data domain knowledge to ensure complex business rules translate correctly into the new platform.

Key Responsibilities

• Support and drive the migration from on-premises data infrastructure to Databricks
• Design and build data solutions using Medallion Architecture and Data Vault modelling principles
• Develop and maintain data pipelines using Databricks, PySpark, Python, and SQL
• Apply SAP data exposure to support finance and economics data workstreams through the migration
• Translate complex business and finance rules into robust, governed data engineering solutions
• Engage business and technical stakeholders, including C-suite, on migration progress and outcomes
• Ensure the emerging data platform meets governance, quality, and security standards

Requirements

• Senior-level Databricks experience, including PySpark and Python
• Strong SQL skills and experience with Data Vault modelling and Medallion Architecture
• SAP exposure, particularly within Finance or Economics data domains
• Experience managing data migrations from on-premises environments to cloud or lakehouse platforms
• Ability to communicate technical progress and risks clearly to C-suite stakeholders
• Finance or Economics data domain experience highly advantageous
• Duration: 6 months
• Location: Cape Town, hybrid (3 days on-site per week)