Lead Data Engineer
Summary
Lead Data Engineer on a remote-first UK public sector Lakehouse programme (contract, inside IR35). You'll own delivery quality and standards, design complex pipeline patterns (CDC, parallel load), and mentor data engineers using AWS Glue, S3, MWAA, Apache Iceberg, Python, PySpark, and Terraform.
Lead Data Engineer REMOTE - Public Sector (SC Cleared)
Want to be the technical anchor on a data engineering team that's shaping how a major public sector programme handles data at scale? This is that role.
We're looking for an experienced Lead Data Engineer to drive delivery on a high-profile, remote-first Lakehouse programme — owning quality, mentoring the team, and setting the standard for how pipelines get built.
Up to £440/day (inside IR35)
Remote — work from anywhere in the UK
Active SC Clearance required
️ Immediate start
What you'll be doing:
Leading data engineering delivery across source connectivity & transformation — accountable for sprint output and quality
Designing complex pipeline patterns for large and XL-complexity feeds, including CDC and parallel load
Governing pattern reusability and correctness before feed supplier handover — your standards, applied across the team
Mentoring Data Engineers, running design reviews, and enforcing data engineering standards across the board
Tech stack: AWS Glue, S3, MWAA, Apache Iceberg, Python, PySpark, Terraform
Must-have: Active SC Clearance + proven leadership in data pipeline design
This isn't a "build what you're told" role — you'll be setting the technical direction and mentoring engineers on one of the most complex data feeds programmes in the public sector right now.
Ready to lead? Drop me a message or send your CV over — let's talk.
#LeadDataEngineer #DataEngineering #AWS #CDC #SCCleared #ContractJobs #PublicSector