Hybrid Data Engineer – PySpark on AWS
Summary
Develop scalable AWS data solutions and design PySpark ETL pipelines using EMR, Lambda, and EC2 to power reporting, analytics, and strategic decision-making in Manchester.
DWP is seeking a Data Engineer to join the Management Information (MI) team. You will develop scalable data solutions using AWS technologies to power reporting, analytics, and strategic decision-making.
Based in Manchester, you will design and orchestrate PySpark ETL pipelines with EMR, Lambda, and EC2, collaborating with a broad range of stakeholders to ensure data quality and security, while contributing to Agile delivery and CI/CD practices.