Azure Data Engineer
Posted Updated
Description
PBT Group in Johannesburg is seeking two Azure Data Engineers to implement a Medallion (Lakehouse) architecture. You will land data into the bronze layer and drive semantic modelling through to the gold layer, ensuring governance and AI-ready data products.
Work with in-house data scientists to deliver analytics-ready datasets and Power BI business views, with a strong focus on production deployment, operational excellence and Git + DevOps practices.
Design, build and maintain data pipelines (Databricks and ADF) to ingest and land data into the bronze layer. Support semantic data modelling across silver and gold layers to create high-quality, governed data products. Collaborate with data scientists to deliver analytics-ready datasets and Power BI business views. Ensure data is production-ready, well-documented and aligned with AI use-case requirements. Apply Unity Catalog / Gateway for data governance and access control. Contribute to technical documentation covering design decisions, pipelines and data models. Work within an Agile delivery framework and follow Git + DevOps best practices. Support the use of Databricks Genie where relevant. Advanced Azure Databricks experience (Databricks Data Engineer certification preferred; Databricks AI certification advantageous). Strong proficiency in Python and SQL for developing data products and pipelines. Hands-on experience with Azure Data Factory (ADF) pipelines. Experience with Medallion / Lakehouse architecture (bronze, silver, gold layers). Semantic data modelling skills. Familiarity with Unity Catalog / Gateway. Solid understanding of Git and DevOps practices. Ability to produce clear technical documentation. Experience working in Agile environments.Skills
Sign in to read and join the discussion.