Data Engineer - DV Cleared
Salary: £? - ? per year
Requirements:- Proven commercial experience delivering data engineering solutions in project or production environments.
- Strong Python and SQL skills.
- Hands-on experience with Apache NiFi and data pipeline orchestration.
- Data modelling and schema design experience.
- Experience with Parquet and S3-compatible object storage.
- Experience integrating data from REST APIs.
- Experience with OpenShift or Kubernetes.
- Experience with GitLab CI/CD and automated build, test and deployment pipelines.
- Experience developing data contracts or Interface Control Documents (ICDs).
- Experience with data validation and assurance.
- Experience with metadata management, data lineage and traceability.
- Strong problem-solving and critical-thinking skills.
- Confident communication with technical and customer stakeholders.
- DV clearance is essential for this role, with EDV clearance also welcomed.
- STEM, Data, AI, Programming or related degree is desirable.
- Experience influencing technical decisions or helping develop technical capability is desirable.
- Experience with big-data technologies such as Spark, Hadoop or NiFi is desirable.
- Exposure to Ansible and Terraform is desirable.
- Understanding of machine-learning algorithms and deployment is desirable.
- Design, build and maintain secure and scalable data engineering solutions.
- Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi.
- Design data models, schemas and data contracts / Interface Control Documents (ICDs).
- Integrate data from REST APIs and other source systems.
- Work with Parquet and S3-compatible object storage.
- Implement data validation, assurance, metadata management and data lineage.
- Develop automation and data-driven tools to support customer requirements.
- Contribute to technical decisions and investigate emerging technologies where appropriate.
- Work collaboratively with technical and customer stakeholders to understand requirements and deliver solutions.
- Take ownership of technical deliverables, ensuring they are secure, high quality and maintainable.
- AI
- Ansible
- CI/CD
- GitLab
- Hadoop
- Support
- Kubernetes
- OpenShift
- Python
- REST
- SQL
- Spark
- Terraform
- API
- DevOps
More:
We are hiring a Senior Data Engineer for a high-profile defence programme supporting MOD customers. The role is based around Bristol and MOD sites in Wiltshire, with approximately 50% of the time spent on MOD sites and the remainder working on a hybrid basis, and occasional work from other sites may be required. This is a 3-month initial contract with a strong expectation of extension up to 12 months, offered inside IR35 at £55-£60 per hour. A key benefit of this opportunity is a condensed working week, where you may work 3 days and be paid for 5, alongside hybrid working and the chance to contribute to secure data engineering projects in a multidisciplinary technical environment.
last updated 39 week of 2026