Data Engineer — PySpark & AWS for Strategic Analytics
Summary
A data engineer joins DWP Digital's Management Information team to build scalable data pipelines in a hybrid cloud using AWS and PySpark, delivering analytics-ready data for reporting and decision-making. Day-to-day involves collaborating with analysts and data scientists, contributing to CI/CD, and ensuring data quality and security in a 40% home / 60% hub hybrid setup.
DWP Digital is seeking a Data Engineer to join the Management Information (MI) team. You will build scalable data solutions in a hybrid cloud environment using AWS and PySpark, delivering analytics-ready data for reporting and decision-making.
You will collaborate with analysts and data scientists, contribute to CI/CD, and help ensure data quality and security while working in a flexible hybrid setup with 40% home and 60% hub time.