Data Engineer – AWS PySpark & Scalable Data Pipelines
Summary
The Data Engineer will develop and maintain scalable data pipelines and products using AWS and PySpark to support reporting and analytics within DWP Digital. The role involves working in a hybrid cloud environment while adhering to Agile and CI/CD practices.
DWP Digital is seeking a Data Engineer to join the Management Information team and help shape the future of data. You will develop scalable data solutions using AWS technologies to power reporting, analytics, and strategic decision-making.
The role operates in a hybrid cloud environment, designing and maintaining data products used by analysts and data scientists, and contributing to Agile and CI/CD practices to ensure high standards of data quality and security.