Data Engineer
Summary
Data engineer building mission-critical data pipelines and integrations for national security customers in Gloucester. Day to day involves designing ETL/ingestion pipelines, data models, and data stores using Kafka, NiFi, SQL/NoSQL (MongoDB), and Groovy/Python/Java, with TDD and security best practices. Requires active Enhanced DV clearance.
Salary: £70,000 - 70,000 per year
Requirements:
- We require active Enhanced DV Clearance (West).
- We require willingness to work full time on site in Gloucester when needed.
- We require experience with Apache Kafka.
- We require experience with Apache NiFi.
- We require experience with SQL and NoSQL databases, such as MongoDB.
- We require experience with ETL processing languages such as Groovy, Python, or Java.
- We require experience in data pipelines, ETL processing, and data integration.
Responsibilities:
- We develop mission-critical data solutions and manage pipelines that turn diverse data sources into valuable insights for our National Security customers.
- We collaborate with clients to solve complex challenges using distributed computing techniques for large-scale, real-time, and unstructured data.
- We design and develop data pipelines, including ingestion, orchestration, and ETL processing.
- We ensure data consistency, quality, and security across all processes.
- We create and maintain database schemas and data models.
- We integrate and enrich data from diverse sources while maintaining data integrity.
- We maintain and enhance architectural components such as Data Ingest and Data Stores.
- We troubleshoot and diagnose issues within integrated and enriched data systems.
- We collaborate with the scrum team to break down user requirements into epics and stories.
- We write clean, secure, and reusable code using a test-driven development approach.
- We monitor system performance and implement updates to maintain optimal operation.
Technologies:
- AI
- Cloud
- DevOps
- ETL
- Groovy
- Java
- Kafka
- MongoDB
- NoSQL
- Python
- SQL
- Security
More:
We are a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. We work with cutting-edge technologies across AI and Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. We have long-term contracts secured across the latest customer framework and are set for significant growth. The role is based in Gloucester with hybrid working where possible, and we offer a competitive salary depending on experience.
Benefits:
- a 6% bonus
- 25 days holiday
- a clearance bonus
last updated 40 week of 2026