Lead Software Development Engineer in Test - AI Product Automation
Description
About the Role:
We are looking for an experienced Lead Software Development Engineer in Test (Lead SDET) to lead quality engineering for our AI products. This role requires deep expertise in AI/ML testing, test automation architecture, and quality engineering strategy.
You will own the end-to-end quality charter for the AI vertical, define scalable testing methodologies, and architect robust, reusable, cross-platform automation frameworks. You will also drive organisation-wide quality initiatives, mentor engineering teams, and collaborate with cross-functional stakeholders to shape the AI quality roadmap.
Key Responsibilities:
- Quality Strategy & Leadership: Define and own the overall QA strategy and end-to-end quality charter for the AI vertical.
- Automation Architecture: Design and architect large-scale, reusable, scalable, and cross-platform test automation frameworks.
- AI & Model Testing: Develop comprehensive testing strategies for AI/ML systems, including RAG pipelines, hallucination detection, model drift, bias, and output accuracy.
- AI Quality Roadmap: Drive the AI quality roadmap, establish testing standards, and implement organisation-wide quality initiatives.
- Technical Ownership: Own key decisions related to test strategy, automation tools, frameworks, and AI testing methodologies.
- Team Leadership: Mentor, coach, and upskill the QA/SDET team, establish engineering best practices, and build a strong talent pipeline.
- Cross-functional Collaboration: Influence engineering, product, and architecture teams to embed quality throughout the product development lifecycle.
- Risk & Reliability Management: Identify and mitigate product and model-level quality risks while improving system reliability, scalability, and test coverage.
- Continuous Improvement: Establish quality metrics, improve testing efficiency, and drive continuous improvement across the organisation.
Required Skills & Experience:
- 7+ years of overall experience in Software Quality Assurance (QA), Test Automation, or SDET roles.
- Deep expertise in AI/ML testing, including testing AI tools, models, and AI-powered applications.
- Hands-on experience designing testing methodologies for RAG pipelines, hallucination detection, model drift, bias, and AI output evaluation.
- Proven experience architecting large-scale, reusable, and cross-platform test automation frameworks.
- Strong understanding of software testing methodologies, automation architecture, and quality engineering practices.
- Demonstrated experience leading and mentoring QA/SDET teams, setting technical standards, and driving engineering excellence.
- Ability to independently define testing strategies and make technical decisions regarding tools, frameworks, and methodologies.
- Strong stakeholder management and communication skills, with the ability to influence cross-functional teams and participate in system architecture discussions.
- Experience owning end-to-end quality engineering strategy at a product, platform, or vertical level.
Good to Have:
- Experience working with CI/CD pipelines and integrating automated testing into continuous delivery workflows.
- Exposure to cloud platforms such as AWS, GCP, or Microsoft Azure.
- Familiarity with MLOps pipelines, model lifecycle management, and monitoring AI systems in production.
- Experience with performance, load, and scalability testing of AI/ML workloads.
- Familiarity with AI evaluation frameworks and tools for assessing model quality and reliability.
What Success Looks Like:
- A well-defined and scalable quality engineering strategy for the AI vertical.
- Robust automation frameworks with high reusability and maintainability.
- Reliable testing methodologies for RAG, hallucination, bias, and model drift.
- Improved product quality, reduced engineering risks, and better release confidence.
- A technically strong and independently operating QA/SDET team.
Skills
Sign in to read and join the discussion.