Senior Quality Analyst (Automation & Manual)
Posted Updated
Description
Senior Quality Analyst (Automation & Manual)
Company: InXiteOut
Job Location: India
Employment Type: Full-time
Experience Required: 8+ years
Job Title:
SDET (Software Development Engineer in Testing) Senior Automation QA & Manual Testing
Experience: 8+ Years
Employment Type: Full-Time
Dept:
FSD
Designation:
Senior Specialist FSD QA
Location: Hybrid
About Us
At InxiteOut Pvt. Ltd., we specialize in building next-generation AI-powered applications that solve real-world business problems. We are expanding our QA team to ensure our AI systems are robust, secure, and aligned with user expectations.
Key Responsibilities
Strong knowledge of Python. Configure and test AI/ML product/system. Lead the quality assurance strategy and establish automation frameworks from scratch. Manage and mentor junior QA engineers and guide them in test automation and AI system validation. Own functional and non-functional testing across complex distributed systems. Own API, integration, acceptance, system, and end-to-end (E2E) testing. Lead test planning, test case design, and execution for web, API, and AI-based systems. Design and maintain regression test suites and ensure full coverage. Collaborate with Full Stack Developers, Data Scientists, and AI Engineers to define test strategies for LLM-based features. Own testing of AI-specific behaviors including:Hallucination and factual accuracy
Consistency in prompt-response pairs
Retrieval-Augmented Generation (RAG) flows Collaborate with developers, product owners, and other QA engineers in Agile teams.
Must-Have Skills
Deep experience in Functional Testing:Advanced REST API Testing (Postman, REST Assured, etc.)Integration, Acceptance, E2E, Smoke, Sanity, System Testing Strong foundation in Non-Functional Testing:Performance and Load TestingStress and Security Testing Proficiency in Testing Methods:Black-box, White-box, Grey-box Testing Regression Testing lifecycle ownership Expertise in automation frameworks (e.g., Selenium, Playwright, Cypress, TestNG) Strong scripting/coding skills in Python (preferable) / Java / JavaScript Familiarity with containerized environments (Docker, Kubernetes)
Good-to-Have (AI Testing Focus)
Exposure to testing AI/ML products/systems.
Experience of integrating tests into CI/CD pipelines (GitHub Actions, GitLab, Azure DevOps etc.).
Hands-on experience with AI testing tools or custom frameworks.
Familiarity with evaluating LLM (large language model) outputs.
Experience of validating RAG-based architecture.
Understanding of hallucination detection metrics and prompt tuning.
Exposure to safety audits for AI applications.
Collaboration experience with Full Stack, Data Science, Data Engineering & DevOps teams.
Qualifications
Bachelors or masters in computer science, Engineering, or related field.
Certifications in testing or security are a plus (e.g., ISTQB, OWASP). .
Skills
- Agile
- AI
- API
- API Testing
- Automation
- Azure
- Azure DevOps
- CI/CD
- Cypress
- Data Engineering
- Data Science
- DevOps
- Distributed Systems
- Docker
- GitHub
- GitHub Actions
- GitLab
- Java
- JavaScript
- Kubernetes
- LLM
- Machine Learning
- OWASP
- Playwright
- Postman
- Python
- RAG
- REST
- REST Assured
- Safety Audit
- Selenium
- Test Automation
- TestNG
Sign in to read and join the discussion.