Agent Validation Engineer - AI & LLM Applications

Role Overview :

Make sure AI agents and AI-enabled applications work correctly and reliably.

Responsibilities :

- Design and run test scenarios to validate agent behavior

- Validate agent interactions, tool integrations, orchestration workflows and system reliability

- Create test strategies, test plans and QA processes for complex software systems

- Find and troubleshoot defects, issues and workflow inconsistencies

Must-have skills :

- Experience validating AI workflows or AI-enabled applications

- Strong Python skills and automation testing frameworks and tools

- API, integration and functional testing, and test automation

- Strong analytical and troubleshooting skills

- LLM evaluation techniques, prompt validation and hallucination detection

Good to have :

- RAG and multi-agent systems

- Test automation for conversational AI, AI agents and autonomous workflows