Hybrid Data Engineer — PySpark & AWS for Analytics
Summary
Data Engineer designing and building scalable AWS data pipelines with PySpark/EMR for reporting and analytics in a hybrid role.
DWP Digital in the United Kingdom is seeking a Data Engineer to join the Management Information team. You will design and implement scalable data pipelines in AWS, supporting reporting, analytics and strategic decision-making for the department.
You will work with PySpark ETL on EMR, Lambda and EC2, collaborate with stakeholders, and contribute to Agile delivery and CI/CD in a hybrid working pattern.