Senior Data Engineer
Posted Updated
Description
- As a Senior Data Engineer in the Data Architecture team, you’ll design, build and run the pipelines and platform components that make our data secure, reliable and ready to use
- You’ll lead workstreams in our migration to Microsoft Fabric and build the foundations for analytics, self-service reporting and AI. That includes preparing governed data for retrieval-augmented generation (RAG) and Model Context Protocol (MCP)
- You’ll set technical direction within the team, coach less experienced engineers and work with colleagues across the Data Office, IT and the business
- Design, build and run data pipelines using Fabric Data Factory and Fabric Lakehouse, and set patterns for the team to reuse
- Own the ingestion of data from our core systems, including Workday, Dynamics 365, Business World and SharePoint
- Design data structures in Fabric Warehouse and Lakehouse, and deliver curated, well-documented datasets for Power BI and other reporting
- Build security, data classification and access controls into every pipeline, and review the work of others against them
- Redesign legacy ETL and ELT processes for Fabric, and plan cut-over so reporting carries on without a break
- Set up version control, CI/CD and automated testing for data solutions, and monitor pipelines for performance and cost
- Coach and mentor less experienced engineers
Benefits
- Income protection
- Matched pension
- Life cover
- Private medical, including anytime access to Doctor@Hand and Stronger Minds
- Professional subscriptions
- Experience of version control, for example Git, and of applying CI/CD to data solutions
- Experience in professional services or another regulated environment
- It would be great if you had some of the following skills, but don’t worry if you don’t tick every box, we’ll help you develop along the way
- Good knowledge of data governance, security and compliance, including access control and data classification
- Experience with data catalogue, lineage or classification tools
- Experience migrating from Azure Data Factory and Azure Data Lake to Fabric
- Working knowledge of Power BI and how it connects to Fabric datasets
- Joining us as a Senior Data Engineer, the minimum criteria you’ll need is strong, proven experience delivering solutions on Microsoft Fabric (Data Factory, Lakehouse, Warehouse and Notebooks) or Databricks, strong proficiency in Python, PySpark and SQL, a solid understanding of data modelling, warehousing and ETL/ELT principles, and experience of delivering a platform or data migration
- Clear communication with technical and non-technical colleagues, and experience of coaching or reviewing the work of less experienced engineers
- Experience preparing data for AI use, for example RAG, vector databases or MCP, and processing unstructured data such as PDFs and documents
- End Date: December 6, 2026
Skills
Sign in to read and join the discussion.