Senior Data Engineer

Summary

The Senior Data Engineer will build and maintain scalable data pipelines and Lakehouse architectures using Databricks, Spark, and Python. This role involves collaborating with cross-functional teams to deliver data products while driving engineering best practices and platform optimization.

Senior Data Engineer - London (Hybrid) - Databricks - Up to £85,000


We're working with a fast-growing tech company that's putting serious investment into its data platform right now and they need a Senior Data Engineer to help lead the charge. You'll be joining a genuinely collaborative team, with real scope to shape how their Databricks environment evolves and influence the technical decisions that go with it.

It's a cloud-first setup, and you'll be working closely with Data Scientists, Analysts, Product teams and senior stakeholders to build data products that actually matter to the business and not just tick a box. You'll also have a hand in raising the bar on engineering practice more broadly across the team.

The Role

As a Senior Data Engineer, you'll be responsible for:

  • Building and maintaining scalable data pipelines within Databricks.
  • Developing and optimising batch and streaming data workflows.
  • Designing and implementing Lakehouse architectures and medallion data models.
  • Implementing data quality, monitoring, and observability frameworks.
  • Maintaining security, governance and access control standards.
  • Collaborating with Data Scientists and Analysts to deliver business-critical data products.
  • Driving engineering best practice through code reviews and technical standards.
  • Identifying platform optimisation and cloud cost reduction opportunities.
  • Translating business requirements into scalable technical solutions.
  • Contributing to tooling decisions, documentation and continuous improvement initiatives.

Key Skills & Experience

  • Proven experience as a Data Engineer within production environments.
  • Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python and SQL.
  • Experience building and supporting scalable ETL/ELT pipelines.
  • Strong understanding of distributed data processing and data modelling.
  • Cloud platform experience across Azure, AWS or GCP.
  • Experience implementing data quality frameworks and pipeline monitoring.
  • Excellent communication and stakeholder engagement skills.

Why Apply?

  • Salary up to £85,000.
  • Hybrid working model.
  • Modern Databricks and Azure technology stack.
  • Exposure to large-scale, enterprise-level data platforms.
  • Opportunity to influence architecture and engineering standards.
  • Collaborative and supportive engineering culture.
  • Ongoing learning and professional development opportunities.
  • Strong career progression within a growing technology business.

This is a brilliant opportunity to shape a modern Databricks platform while influencing the architectural decisions and working alongside cross-functional data teams. All in a highly collaborative and engineering-led environment.

Interested? Get in touch with Joshua Marchant ->

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.


See also

Data Engineering jobs by country — openings, pay and top skills →

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available