Senior Data Engineer: Databricks, Delta & Real-Time Analytics
Summary
A senior data engineer role in London focused on building scalable data pipelines on Databricks and Delta Lake, including real-time streaming analytics. Day to day involves ingesting SAP data with Qlik Replicate and Azure Data Factory, data modelling, and optimizing analytics structures for reporting, ideally with Azure and energy/commodities exposure.
Eaglecliff is seeking a Senior Data Engineer in London to design and implement scalable data pipelines leveraging Databricks and Delta Lake. You will build streaming solutions for real-time analytics and collaborate with cross-functional teams to meet data requirements.
The role involves ingesting data from SAP sources using Qlik Replicate and ADF, data modelling, and optimizing analytics data structures for reporting. Experience in Azure and the energy/commodities sectors is highly valued.