Senior Databricks Data Engineer
Posted Updated 7
views
Summary
Permanent, hybrid (3-4 days/week in the London office) senior data engineering role in the insurance domain. The person leads technical delivery of enterprise-scale data pipelines using Databricks/Spark (PySpark/SparkSQL), ETL/ELT design, data warehousing and modelling, SQL, Git and CI/CD, while managing project teams.
BU/Segment: Analytics / Data Management / Insurance Domain
Location: London, United Kingdom (Hybrid, 3-4 days in the office)
Employment Type: Permanent to start ASAP
Qualifications and experience we consider to be essential for the role:
- Insurance industry experience is essential, with a strong understanding of policy, claims, and regulatory data.
- A minimum of 5 years' management experience required - leading technical delivery or overseeing project teams within data engineering or integration environments.
- 8-10 years' experience in data engineering and integration, ideally in enterprise-scale environments.
- Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design, and data pipeline orchestration.
- Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts.
- Experience working with large, complex datasets and distributed computing environments.
- Proficiency in SQL, version control (e.g. Git), and CI/CD pipelines.
- Familiarity with Agile delivery and DevOps practices (Azure DevOps, JIRA, etc.).