Senior Data Engineer: Azure Data Pipelines Lead
Summary
Senior Data Engineer at DWP (UK Department for Work and Pensions) designing and building scalable ETL/ELT pipelines with Python and PySpark on Azure. Day to day involves leading technical teams, delivering cloud-based data platforms, and working with stakeholders across multiple data domains to create trusted data assets.
DWP is seeking a Data Engineer to design, build and enhance scalable ETL/ELT pipelines using Python and PySpark, ensuring data solutions are reliable and efficient. The role requires leadership of technical teams to deliver cloud-based data platforms that support decision-making across the organisation.
Successful candidates will work across multiple data domains, collaborating with stakeholders to transform requirements into trusted data assets while adhering to engineering standards and