QA Analyst / Tester
Summary
QA Analyst in Mumbai who tests AI-driven dashboards, reporting systems, and data pipelines: writing test plans and UAT cycles, validating data accuracy with SQL, checking AI/prompt outputs against business logic, and building QA automation using Python, SQL, and low-code tools.
Role & responsibilities
The QA Analyst / Tester will play a key role in ensuring the accuracy, performance, and reliability of AI-driven data solutions, reporting dashboards, and automation products. This role requires a balance of analytical thinking, structured testing, and technical understanding of AI and data systems.
Key Responsibilities
1. **Testing & UAT for AI Solutions**
- Develop and execute test plans, test cases, and validation scripts for AI-driven dashboards and reporting systems.
- Participate in user acceptance testing (UAT) cycles, document issues, and track closure with development teams.
- Validate prompt responses and AI outputs for consistency, relevance, and alignment with business logic.
2. **Data Quality Assurance**
- Validate data accuracy, transformations, and integrity across data pipelines (SQL, APIs, cloud sources).
- Ensure dashboard metrics align with underlying source data and business KPIs.
- Perform regression and sanity checks post data refresh or model updates.
3. **Automation & Process Optimization**
- Support test automation and data validation processes using Python, SQL, or low-code testing tools.
- Document repeatable QA workflows and assist in building QA automation frameworks for dashboards and agents.
- Provide insights to improve data quality, system reliability, and reporting consistency.
4. **Collaboration & Reporting**
- Work closely with project managers, BSA, and developers to ensure smooth QA handoffs.
- Communicate QA progress, risks, and dependencies proactively.
- Maintain detailed QA documentation and UAT feedback logs.
Required Skills & Experience
- 25 years of experience in QA, preferably with data or AI-driven products.
- Strong understanding of data validation, SQL querying, and dashboard testing (Power BI, Tableau, etc.).
- Exposure to AI/ML-based products or chat/insight generation models (OpenAI, LangChain, etc.) preferred.
- Experience with Jira, ClickUp, or similar tools for test case management and defect tracking.
- Strong analytical, documentation, and communication skills.
Behavioral Competencies
- Detail-oriented and methodical with strong problem-solving mindset.
- Comfortable working in fast-paced agile environments.
- Collaborative and proactive in cross-functional discussions.
- Strong ownership and accountability for quality outcomes.