Data Engineer - AWS Databricks Pipelines (Hybrid)
Posted Updated
Description
Edenred PayTech in Swindon/London is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure on our platform. You will work across sources, load and transform data, ensuring quality, reliability and regulatory reporting.
You will collaborate with analysts to refine requirements, estimate efforts, and suggest improvements to the data platform while solving production issues. Hybrid work available.
Design, develop and maintain data pipelines and infrastructure on AWS. Produce reports required for regulatory compliance. Collaborate with business analysts to refine user requirements and provide estimates. Proactively suggest ideas to improve the data platform and ways of working. Troubleshoot production issues. Unit Testing. Documentation. Proven track record of development in Databricks. Proven track record of working with IaC. Proven track record of working with git. Strong working knowledge of Python (Pyspark) and SQL. Strong working knowledge of data management inside a datalake. Proven ability to explain technical issues and solutions to peers and customers. Proven ability to independently progress and complete tasks. Strong desire to learn new skills and adapt new technologies. 25 days annual leave Hybrid working environment Pension scheme Discretionary bonus Medical & international travel cover Life insurance Wellbeing programme Cycle to Work Employee discount platform Digital learning platform Volunteering programme Social eventsSkills
Sign in to read and join the discussion.