Data Engineering Lead
Summary
Leads a multidisciplinary data engineering team owning an enterprise data platform on Microsoft Azure and Microsoft Fabric — defining platform strategy, building batch and real-time AI-ready pipelines, and driving DataOps, CI/CD, governance and POPIA compliance.
Lead Innovation. Build Scalable Data Platforms. Power the Future of AI.
Are you an experienced Data Engineering Leader ready to drive enterprise-wide data transformation?
We're looking for a strategic, hands-on Data Engineering Lead to take ownership of our enterprise data platform across Microsoft Azure and Microsoft Fabric.
Reporting to the Head of Data & AI Strategy, you'll lead a multidisciplinary engineering team, modernise our data ecosystem and build scalable, secure and AI-ready data solutions.
WHAT YOU'LL BE DRIVING
- Define and execute the enterprise data platform strategy and roadmap.
- Lead cloud architecture, implementation and migration to Azure and Microsoft Fabric.
- Manage and mentor Data Engineers, a Data Architect and Platform/DataOps Engineers.
- Oversee end-to-end data engineering delivery, production operations, SLAs and disaster recovery.
- Drive DataOps, CI/CD, automation, Medallion Architecture and modern engineering practices.
- Establish data governance, security, quality and POPIA compliance standards.
- Build reliable batch and real-time data pipelines supporting AI, advanced analytics and BI.
- Manage platform performance, cloud costs, vendors and strategic stakeholders.
ESSENTIAL REQUIREMENTS
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science or a related field.
- 7+ years in Data Engineering and Data Platform Development.
- 3+ years leading technical engineering teams, including line management.
- 3+ years hands-on experience with Microsoft Azure data services.
- Minimum 1 year hands-on production delivery using Microsoft Fabric, or migration to Fabric.
- Proven experience designing enterprise-scale cloud data platforms.
- Experience managing production environments, SLAs, incidents and disaster recovery.
- Strong exposure to large-scale data transformation, DataOps, governance and security within regulated environments.
- Experience supporting AI, advanced analytics and real-time data solutions.
TECHNICAL EXPERTISE
- Microsoft Fabric: OneLake, Lakehouse, Warehouse, Data Factory, Real-Time Intelligence and Power BI.
- Azure: ADF, Synapse, Databricks, Azure SQL, Event Hubs, Azure DevOps and related cloud services.
- Engineering: Python, SQL, Spark, PySpark, ETL/ELT, API Integration and Streaming Pipelines.
- DataOps & Governance: Git, CI/CD, Terraform/Bicep, Microsoft Purview, Observability and Data Security.
Advantageous: A relevant postgraduate qualification and Microsoft certifications (DP-700, DP-600 or AZ-305).
READY TO ENGINEER WHAT'S NEXT?
If you combine strong technical expertise with strategic thinking, people leadership and a passion for building future-ready data platforms, we want to hear from you!
#NowHiring #DataEngineeringLead #MicrosoftFabric #Azure #DataLeadership #DataEngineering We are committed to providing equal opportunities to all applicants from diverse backgrounds. Please note only candidates meeting the specified criteria will be considered.
Skills
- AI
- Analytics
- API
- Automation
- Azure
- Azure Data Factory
- Azure DevOps
- Bicep
- CI/CD
- Cloud
- Data Engineering
- Data Governance
- Data Pipelines
- Data Science
- Databricks
- DataOps
- DevOps
- ELT
- ETL
- Git
- Lakehouse
- Medallion Architecture
- Microsoft Fabric
- Microsoft Purview
- Observability
- Power BI
- PySpark
- Python
- Spark
- SQL
- Terraform