Test Lead - AI Agent Testing (Pune)
Posted Updated
Description
Test Lead - AI Agent Testing (Pune)
Company: Hexaware Technologies
Job Location: Pune, Maharashtra, India
Employment Type: Full-time
Experience Required: 5 - 8 years
Role & responsibilities
Experience: 5-8 Years
Location: Bengaluru / Hybrid
Employment Type: Full-Time
About the Role
We are seeking an experienced and highly motivated Senior AI QA Engineer to ensure the quality, reliability, performance, security, and accuracy of enterprise-grade AI ideal candidate will have strong experience testing up-to-date web applications, APIs, cloud-native systems, and AI-powered solutions built using LLMs, Agentic AI frameworks, RAG architectures, Vector Databases, and Knowledge Graphs.
You will work closely with AI Developers, Architects, Product Managers, and DevOps teams to establish quality engineering practices across the entire AI application lifecycle.
Key Responsibilities
Application Testing
Validate React.js frontend backend services built using Python and Node.js.
Perform Functional, Integration, Regression, System, and User Acceptance Testing.
Validate REST APIs and microservices.
Ensure end-to-end business workflow & Agent Testing
Test AI agents built using Lang
Graph and Lang
Chain.
Validate agent orchestration workflows and decision-making tool calling, MCP integrations, and agent-to-agent test scenarios for multi-agent systems.
Validate prompt templates and prompt execution behavior.
RAG & Search Validation
Validate document ingestion pipelines.
Test chunking strategies and embedding vector database indexing and retrieval quality.
Validate semantic search accuracy.
Measure retrieval precision and relevance scores.
Test grounding quality and hallucination prevention.
Knowledge Graph Testing
Test Neo4j graph ingestion pipelines.
Validate node and relationship graph traversal accuracy.
Test graph-based reasoning workflows.
LLM Testing
Validate GPT, Claude, Gemini, Llama, and other model AI evaluation response consistency and reliability.
Validate hallucination factual c .
Skills
Sign in to read and join the discussion.