Data Engineer — PySpark & AWS for Strategic Analytics
Summary
Builds scalable data pipelines in AWS using PySpark to prepare analytics-ready datasets for government reporting and decision-making, collaborating with analysts and ensuring data quality in a hybrid work environment.
DWP Digital is seeking a Data Engineer to join the Management Information (MI) team. You will build scalable data solutions in a hybrid cloud environment using AWS and PySpark, delivering analytics-ready data for reporting and decision-making.
You will collaborate with analysts and data scientists, contribute to CI/CD, and help ensure data quality and security while working in a flexible hybrid setup with 40% home and 60% hub time.