IN_Senior Associate_Automation Engineer with AI\GCC_Advisory_Bangalore (India)
Posted Updated
Description
| Job Description & Summary: | We are looking for highly skilled Automation Engineers with AI Testing expertise to join our growing team. The ideal candidate will have strong experience in test automation using Playwright and hands-on exposure to AI/GenAI application testing, including validation of LLM outputs, AI model responses, and non-deterministic behaviors. This role will play a key part in ensuring the quality, reliability, and performance of AI-powered applications throughout the Software Testing Life Cycle (STLC). |
| Job Position Title: | IN_Senior
Associate_Automation Engineer with AI\GCC_Advisory_Bangalore (India) |
| Responsibilities: | Design, develop, and execute automated test
scripts using Playwright. Build robust automation frameworks for web and AI-powered applications. Validate and test Generative AI applications, LLMs, chatbots, copilots, and AI-driven workflows. Develop strategies for testing non-deterministic outputs, prompt responses, and model behavior. Collaborate with developers, product owners, and AI teams to define test scenarios and quality standards. Integrate automated test suites into CI/CD pipelines. Analyze test results, identify defects, and drive issue resolution with development teams. Ensure high test coverage across functional, regression, integration, and end-to-end testing. |
| Mandatory skill sets: | 4-8 years of experience in Automation
Testing and Quality Engineering. Strong understanding of software testing principles, STLC, and Agile methodologies. Experience with CI/CD tools such as Jenkins, GitLab CI, Azure DevOps, or similar platforms. Knowledge of version control systems such as Git. Familiarity with API testing and test automation best practices. Strong analytical and problem-solving skills with keen attention to detail. Excellent communication and stakeholder management skills. |
| Preferred skill sets: | Experience testing Generative AI
applications, LLMs, RAG-based systems, chatbots, or AI agents. Knowledge of prompt engineering and AI evaluation techniques. Exposure to cloud platforms such as Azure, AWS, or GCP. Understanding of AI quality metrics, hallucination detection, and response validation methodologies. |
| Years of experience required: | 4 to 8 Years |
| Education qualification: | BE/B.Tech/M.Tech/MBA/MCA |