AWS Data Engineer - Secure environment
Summary
Design, build, and maintain a secure, scalable AWS data platform for a government client in Cheltenham, supporting real-time and batch analytics. Day to day you build data pipelines, lead data modelling, and scale the platform using EC2, RDS, Lambda, Athena and Glue; DV security clearance (or eligibility) with sole British nationality is required.
In this role you design, build and maintain a secure, scalable data platform for a government client to support real-time and batch analytics. You will work with cross-functional teams to ensure robust data pipelines and aligned architecture, addressing performance and security needs. You lead data-modeling efforts and platform scaling to accommodate evolving use cases. This role offers the opportunity to shape data-driven decision-making in a mission-critical context. You will operate in a fast-growing consultancy culture that values collaboration and impact.
Responsibilities- Build, test, and maintain robust data pipelines
- Design logical and physical data models
- Scale the data platform to meet evolving use cases
- Analyze data flows and improve processing performance
- Ensure data architecture aligns with standards
- Troubleshoot issues and drive continuous improvement
- Proven experience building data pipelines
- Strong understanding of data modelling and structures
- Hands-on experience with AWS services (EC2, RDS, Lambda, Athena, Glue)
- Knowledge of relational and NoSQL databases
- Python or equivalent scripting language
- Experience with test-driven development
- Familiarity with Agile delivery
- DV Security Clearance or eligibility; sole British nationality
- EC2
- RDS
- Lambda
- Athena
- Glue
- Relational databases