Lead Data Engineer
Summary
Lead Data Engineer for a remote-first public sector Lakehouse programme: you own pipeline delivery (source connectivity, transformation, CDC, parallel load), mentor engineers and set engineering standards. Stack: AWS Glue, S3, MWAA, Apache Iceberg, Python, PySpark, Terraform. Up to £440/day, active SC clearance required.
Lead Data Engineer REMOTE - Public Sector (SC Cleared)
Want to be the technical anchor on a data engineering team that's shaping how a major public sector programme handles data at scale? This is that role.
We're looking for an experienced Lead Data Engineer to drive delivery on a high-profile, remote-first Lakehouse programme — owning quality, mentoring the team, and setting the standard for how pipelines get built.
Up to £440/day (inside IR35)
Remote — work from anywhere in the UK
Active SC Clearance required
️ Immediate start
What you'll be doing:
Leading data engineering delivery across source connectivity & transformation — accountable for sprint output and quality
Designing complex pipeline patterns for large and XL-complexity feeds, including CDC and parallel load
Governing pattern reusability and correctness before feed supplier handover — your standards, applied across the team
Mentoring Data Engineers, running design reviews, and enforcing data engineering standards across the board
Tech stack: AWS Glue, S3, MWAA, Apache Iceberg, Python, PySpark, Terraform
Must-have: Active SC Clearance + proven leadership in data pipeline design
This isn't a \"build what you're told\" role — you'll be setting the technical direction and mentoring engineers on one of the most complex data feeds programmes in the public sector right now.
Ready to lead? Drop me a message or send your CV over — let's talk.
#LeadDataEngineer #DataEngineering #AWS #CDC #SCCleared #ContractJobs #PublicSector