Senior Data Engineer: Real-Time Pipelines (Databricks)
Summary
Senior Data Engineer role in central London building scalable, real-time data pipelines and analytics using Databricks, Delta Live Tables, and Spark streaming in an Azure cloud environment, including ingesting SAP data via Qlik Replicate and Azure Data Factory with a focus on data quality and governance.
Certain Advantage is recruiting a Senior Data Engineer for a central London role focused on scalable data pipelines and real-time analytics. You will work with Databricks, Delta Live Tables and Spark streaming within an Azure cloud setting, ingesting SAP data via Qlik Replicate and ADF to ensure data quality and governance.
The position emphasizes collaboration with cross-functional teams, performance tuning, and robust data architectures to support decision-making across the organization.