Senior Data Engineer
Summary
Hands-on Senior Data Engineer role at a global financial services company, building and scaling an enterprise Lakehouse data platform with ETL/ELT pipelines, Spark, Delta Live Tables, and Terraform while contributing to AI initiatives.
We are working with a leading global Financial Services business to hire a Senior Data Engineer into their growing data engineering practice. This is a hands‑on technical role sitting at the centre of a major enterprise data platform build, with scope to influence architecture, drive pipeline development, and contribute to AI initiatives across a complex, high-volume financial data environment.
Responsibilities
- Design and develop scalable data solutions on a Lakehouse architecture platform, supporting enterprise‑wide data processing and analyticsBuild, optimise, and maintain ETL/ELT pipelines and structured streaming workflows for both batch and real‑time data ingestionConfigure and tune clusters and Spark jobs to deliver consistent performance at scaleUtilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governanceApply IAM best practices and maintain compliance with data security standards across the platformSupport infrastructure provisioning and resource management using TerraformImplement monitoring frameworks covering pipeline performance, data quality, and operational healthContribute to code reviews, technical documentation, and team knowledge‑sharingWork within an Agile delivery model, collaborating closely with data scientists, analysts, and business stakeholdersExplore emerging technologies and AI tooling to enhance development productivity and platform capability