Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Zealant Consulting Group

NewBe an early applicant

Lead Software Development Engineer in Test - AI Product Automation

Posted Updated

Description

About the Role:

We are looking for an experienced Lead Software Development Engineer in Test (Lead SDET) to lead quality engineering for our AI products. This role requires deep expertise in AI/ML testing, test automation architecture, and quality engineering strategy.

You will own the end-to-end quality charter for the AI vertical, define scalable testing methodologies, and architect robust, reusable, cross-platform automation frameworks. You will also drive organisation-wide quality initiatives, mentor engineering teams, and collaborate with cross-functional stakeholders to shape the AI quality roadmap.

Key Responsibilities:

- Quality Strategy & Leadership: Define and own the overall QA strategy and end-to-end quality charter for the AI vertical.

- Automation Architecture: Design and architect large-scale, reusable, scalable, and cross-platform test automation frameworks.

- AI & Model Testing: Develop comprehensive testing strategies for AI/ML systems, including RAG pipelines, hallucination detection, model drift, bias, and output accuracy.

- AI Quality Roadmap: Drive the AI quality roadmap, establish testing standards, and implement organisation-wide quality initiatives.

- Technical Ownership: Own key decisions related to test strategy, automation tools, frameworks, and AI testing methodologies.

- Team Leadership: Mentor, coach, and upskill the QA/SDET team, establish engineering best practices, and build a strong talent pipeline.

- Cross-functional Collaboration: Influence engineering, product, and architecture teams to embed quality throughout the product development lifecycle.

- Risk & Reliability Management: Identify and mitigate product and model-level quality risks while improving system reliability, scalability, and test coverage.

- Continuous Improvement: Establish quality metrics, improve testing efficiency, and drive continuous improvement across the organisation.

Required Skills & Experience:

- 7+ years of overall experience in Software Quality Assurance (QA), Test Automation, or SDET roles.

- Deep expertise in AI/ML testing, including testing AI tools, models, and AI-powered applications.

- Hands-on experience designing testing methodologies for RAG pipelines, hallucination detection, model drift, bias, and AI output evaluation.

- Proven experience architecting large-scale, reusable, and cross-platform test automation frameworks.

- Strong understanding of software testing methodologies, automation architecture, and quality engineering practices.

- Demonstrated experience leading and mentoring QA/SDET teams, setting technical standards, and driving engineering excellence.

- Ability to independently define testing strategies and make technical decisions regarding tools, frameworks, and methodologies.

- Strong stakeholder management and communication skills, with the ability to influence cross-functional teams and participate in system architecture discussions.

- Experience owning end-to-end quality engineering strategy at a product, platform, or vertical level.

Good to Have:

- Experience working with CI/CD pipelines and integrating automated testing into continuous delivery workflows.

- Exposure to cloud platforms such as AWS, GCP, or Microsoft Azure.

- Familiarity with MLOps pipelines, model lifecycle management, and monitoring AI systems in production.

- Experience with performance, load, and scalability testing of AI/ML workloads.

- Familiarity with AI evaluation frameworks and tools for assessing model quality and reliability.

What Success Looks Like:

- A well-defined and scalable quality engineering strategy for the AI vertical.

- Robust automation frameworks with high reusability and maintainability.

- Reliable testing methodologies for RAG, hallucination, bias, and model drift.

- Improved product quality, reduced engineering risks, and better release confidence.

- A technically strong and independently operating QA/SDET team.

Skills

What Lead Software Engineering jobs ask for — and how much of it you have →
Apply

See also

Software Engineering jobs by country — openings, pay and top skills →