Lead Data Engineer

In this Lead Data Engineer role, you shape and operate HMRC’s national-scale data platforms to enable analytics, reporting, and data science. You’ll provide technical leadership across delivery teams, ensuring reliability, security, and future readiness. You’ll drive improvements in data ingestion, transformation, and governance within a DevOps context. This is a high-impact, public-sector data transformation role with a focus on collaboration, coaching, and scalable platforms.

• Flexible and Hybrid Working policies
• 25 days leave (up to 30)
• Civil Service Pension scheme contributions
• Coaching and development
• Family friendly policies
• Support for career progression

• Lead the operation, support, and continuous improvement of enterprise data platforms and services.
• Provide technical leadership across multiple delivery teams
• Ensure security controls and data governance are embedded in platform services
• Engage with internal users and stakeholders to improve self-service data capabilities
• Work with suppliers and partners to design, build, and run data services at scale
• Contribute to out-of-hours support and on-call rotas where required

• Strong experience delivering and operating data platforms at scale (ingestion, transformation, modelling)
• Technical expertise in data engineering approaches and technologies (distributed data platforms, relational/NoSQL, data warehousing/lake)
• Experience building/maintaining data pipelines using ETL/ELT tooling with focus on performance, quality, reliability, and virtualization
• Front-end tooling for reporting, dashboards, analytics, ML/AI
• AWS and Azure cloud-native products (e.g., Glue, Dataflow, Databricks)
• Demonstrable leadership leading engineers/technical teams in agile/DevOps
• Ability to apply security, governance, and best-practice engineering standards
• Strong stakeholder engagement and translating technical concepts to business outcomes

• stakeholder engagement
• leadership
• collaboration
• Distributed data platforms (e.g. Hadoop)
• Relational and NoSQL databases
• Data warehousing and data lake concepts