Senior Data Engineer — Azure Pipelines, Hybrid
Posted 2
views
Summary
Senior Data Engineer at DWP (UK government) building and enhancing scalable ETL/ELT pipelines with Python and PySpark in Azure. Day to day: designing cloud data solutions, translating stakeholder needs into data models, and mentoring the team on engineering best practices.
DWP is seeking an experienced Data Engineer to design, build and enhance scalable ETL/ELT pipelines using Python and PySpark in Azure. You will lead the design and delivery of modern cloud-based data solutions, ensuring high-quality, trusted data for decision-making across the organisation.
You will work with stakeholders to translate complex requirements into efficient data models, while mentoring the team and promoting engineering best practices.