Lead Data Engineer (Databricks)

Lead Data Engineer (Databricks) - London (Hybrid) - Up to £110,000

Databricks - Apache Spark - Delta Lake - Python - SQL - Azure

We’re partnering with a growing technology business investing heavily in its cloud data platform and AI capabilities. This is a senior, hands‑on leadership role where you’ll own the architecture and development of a modern Databricks environment, drive engineering best practice, and mentor a team of Data Engineers while shaping the future of the organisation’s data strategy.

The Role

As Lead Data Engineer, you’ll be responsible for:

• Leading the design, development and optimisation of a Databricks-based data platform.
• Designing enterprise‑scale Lakehouse architectures across cloud platforms.
• Defining data modelling, governance, security and quality standards.
• Leading and mentoring a team of Data Engineers.
• Collaborating with Data Scientists, Analysts and Product teams to support analytics, machine learning and AI initiatives.
• Driving platform performance, scalability and cloud cost optimisation.

What’s On Offer?

• Salary up to £110,000.
• Hybrid working model.
• Technical ownership of a modern Databricks platform.
• Opportunity to influence architecture, tooling and engineering standards.
• Leadership responsibilities with a growing engineering team.
• Exposure to AI, machine learning and large-scale data initiatives.

Key Experience Required

• Proven experience as a Senior or Lead Data Engineer.
• Deep expertise in Databricks, Spark, Delta Lake, Python and SQL.
• Experience designing and scaling cloud-based data platforms.
• Strong knowledge of ETL/ELT, data modelling and distributed processing.
• Experience with Azure, AWS or GCP environments.
• Previous team leadership or mentoring experience.
• Strong stakeholder management and communication skills.