AI Test Engineer (SC Cleared)
Summary
Test Engineer validating AI/ML systems, Generative AI, and RAG pipelines in Microsoft/Azure environments with CI/CD and DevOps practices.
Salary: £? - ? per year
Requirements:- Strong experience delivering quality assurance for AI/ML solutions across the full lifecycle
- Hands-on expertise with Microsoft-based environments, including Azure testing tools and AI platforms
- Proficiency in one or more of the following: Python, Java, JavaScript, SQL, or R
- Proven experience in AI and Generative AI testing
- Proven experience in RAG solution validation, including RAGAS framework
- Proven experience with CI/CD, DevOps, and cloud-based test integration
- Ability to define and implement AI testing strategies and model validation frameworks
- Strong understanding of functional and non-functional testing
- Strong understanding of accessibility, security, and performance testing
- Experience working in regulated or enterprise environments
- Active SC Clearance (mandatory)
- Lead the design and execution of end-to-end test strategies across AI and digital programmes
- Ensure quality across AI models, data pipelines, APIs, and cloud-based services
- Embed test-driven development and behaviour-driven development practices within engineering teams
- Drive improvements in automation frameworks and testing tools
- Provide expert oversight on AI model validation, including Generative AI and RAG solutions
- Identify risks early and implement mitigation strategies
- Mentor and coach engineers to build strong testing capability across teams
- Define and deliver testing strategies aligned to organisational standards
- Lead AI testing, validation, and evaluation frameworks
- Integrate testing within CI/CD and DevOps pipelines
- Champion modern testing approaches, including AI-led and predictive testing techniques
- Collaborate with cross-functional teams including engineering, data science, product, and leadership
- Oversee defect management, quality metrics, and release assurance
- Ensure compliance with accessibility, security, and performance standards
- AI
- Azure
- CI/CD
- Cloud
- DevOps
- Java
- JavaScript
- Python
- RAG
- SQL
- Security
- TDD
More:
We are seeking an experienced Senior Test Engineer (AI) to play a key role in delivering high-quality, reliable artificial intelligence and data-driven solutions within a complex, enterprise-scale environment. This is an exciting 6-month initial contract based in London on a hybrid working pattern, inside IR35 and requiring use of an umbrella company. We offer the opportunity to lead testing strategy across cutting-edge AI systems, with a focus on robust validation, strong governance, and continuous quality improvement across digital platforms.
last updated 32 week of 2026