Skip to content

Search jobs inside your AI agent. Claude, ChatGPT, Gemini, Cursor and Grok

Connect

People First Consultants Pvt Ltd

NewBe an early applicant

Business Analyst - AI Model Evaluation

Posted Updated
Discussion

Description

We are seeking a sharp, assertive, and analytical Business Analyst specializing in AI Model Evaluation to drive a high-impact initiative focused on reviewing and evaluating outputs for cutting-edge AI models. In this role, you will act as a trusted advisor and analytical bridge between client stakeholders, evaluation operators, and client engineering/product teams. You will independently audit evaluation deliverables, diagnose complex operational bottlenecks, and translate manual evaluation data into strategic insights that directly shape model performance, guidelines, and product enhancements. Key Responsibilities include: - Client Management & Advisory: Act as the primary functional and analytical point of contact for client program managers, managing stakeholder expectations, presenting evaluation results, and consulting on evaluation frameworks. - Deliverable Auditing & Quality Diagnostics: Independently review operational outputs and audit sample cases to identify discrepancies, ensure data integrity, and drive corrective actions. - Problem Solving & Operational Enablement: Troubleshoot and resolve complex evaluation challenges and workflow blockers faced by operators. - Product Insights & Cross-Functional Feedback: Analyze manual evaluation data to uncover model performance trends and assertively communicate actionable feedback to product and engineering teams. The ideal candidate will possess strong consultative presence for client management, exceptional analytical and structured problem-solving skills, and familiarity with AI/ML evaluation pipelines, search, or mapping products. Outstanding written and verbal communication skills are essential to bridge technical engineering teams and business stakeholders effectively. This position is based in Hyderabad and requires a minimum of 8 years of experience in relevant fields, with a maximum of 17 years. If you are passionate about AI and have the expertise to drive impactful evaluations, we encourage you to apply.

Skills

Apply

See also

Business Analysis jobs by country — openings, pay and top skills →