Lead Data Platform Engineer -12 Month Secondment
Summary
Lead a team building and maintaining data pipelines, data lakes, and cloud infrastructure using AWS, Spark, and DevOps tools for a fintech credit services division.
Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to join our Ascend Cloud Foundation Platform team for a 12 month fixed-term contract. Reporting into our Engineering Director, you will join an established agile team, with a passion and lead a technical team that supports innovation, learning and collaboration. Ensure that the team follows the highest technical standards. Support Agile methods to deliver high value outcomes.
This is a Hybrid, Nottingham based role (40% in the office).
Main responsibilities:
- Lead an outstanding Agile technical team
- Build data pipelines and data lake
- Deliver quality software
- Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security
- Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps
- Codebase ownership
- Technical Application ownership
- Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins, Harness
- Strong experience of developing on Apache Spark/Hadoop
- Strong experience with AWS cloud services including AWS Glue, S3, Step
- Strong experience building data pipelines and data lake
- Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira
- Significant experience of programming using Scala or Python. Configuration as code principles and API integration
- Write clean, scalable and re-usable code that implements SOLID principles, common design patterns where applicable and adheres to published coding standards
- Experience analyse, investigate and compare large data sets when required
- Functions, Lambdas, EventBridge, SQS and Lake formation
- Experience with automated testing methodologies
Benefits package includes:
- Great compensation package and discretionary bonus plan
- Core benefits include pension, bupa healthcare, sharesave scheme and more
- 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.
Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces 2025 (Fortune Global Top 25), Great Place To Work 26 countries to name a few.
Experian is also proud to be an Equal Opportunity and Aff…
If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.