Senior Data Engineer
Posted Updated
Summary
Senior Data Engineer in South Africa building and optimizing big-data pipelines with Spark/PySpark, advanced Python and T-SQL on a Medallion-architecture lakehouse, using Azure Synapse and Data Factory. The role is being hired through a staffing firm for its client.
Senior Data Engineer
My client is looking for a Senior Data Engineer to join their dynamic team.
Requirements
- Spark / PySpark Expertise – Strong experience with Spark internals, performance tuning, and optimization (6+ years)
- Advanced Python Development – Building production‑grade, modular, and testable Python solutions
- SQL (T‑SQL) Proficiency – Ability to interpret and refactor complex SQL‑based ETL logic
- Data Lakehouse & Delta Lake – Experience with Delta Lake, Parquet, and Medallion Architecture (Bronze/Silver/Gold)
- Azure Data Engineering (Synapse & Data Factory) – Hands‑on experience with Azure Synapse, Dedicated SQL Pools, and data pipelines
- Bachelor's degree in computer science, Information Systems, Engineering, or a closely related field.