AI Trainer (Generative AI & AI Agent Specialist)

Salary: ₱40,000 – ₱60,000 per month

Job Summary

We are looking for an AI Trainer to evaluate, train, and optimize AI models and intelligent agents through prompt engineering, response testing, data annotation, and continuous quality improvement.

Key Responsibilities

1. AI Training & Evaluation

• Evaluate AI-generated responses from platforms such as ChatGPT, Claude, Gemini, and DeepSeek.

• Assess AI responses for accuracy, relevance, clarity, consistency, and compliance with business requirements.

• Identify AI performance gaps and provide structured feedback for improvement.

• Develop test scenarios to assess AI performance in real-world business applications.

2. Prompt Engineering

• Design, test, and refine prompts to improve AI output quality.

• Create standardized prompt templates for different business scenarios.

• Identify and troubleshoot inaccurate, inconsistent, or irrelevant AI responses.

• Conduct comparative testing across different AI models and configurations.

3. AI Agent Testing & Optimization

• Train, test, and evaluate AI agents supporting customer service, business operations, and workflow automation.

• Simulate user interactions and assess AI agent behavior and task completion.

• Identify workflow errors and recommend improvements.

• Collaborate with AI Engineers to enhance agent accuracy, reliability, and performance.

4. Data Annotation & Quality Assurance

• Prepare, label, categorize, and validate AI training and evaluation datasets.

• Review AI-generated content against established quality standards.

• Develop and maintain AI evaluation guidelines and scoring rubrics.

• Ensure data accuracy, consistency, confidentiality, and compliance with company policies.

5. Continuous Improvement & Reporting

• Monitor AI performance and track quality metrics.

• Document testing outcomes, recurring issues, and recommended improvements.

• Support testing of new AI features, prompts, and agent workflows.

• Collaborate with cross-functional teams to align AI performance with operational requirements.

Job Requirements

• Diploma or Bachelor's Degree in Computer Science, Information Technology, Data Science, Linguistics, Communications, or related disciplines.

• 1–3 years of relevant experience in AI training, generative AI evaluation, prompt engineering, data annotation, quality assurance, or related roles.

• Practical experience using generative AI tools such as ChatGPT, Claude, Gemini, or DeepSeek.

• Good understanding of LLMs, prompt engineering, and AI agent workflows.

• Strong analytical thinking, problem-solving abilities, and attention to detail.

• Excellent written and verbal communication skills in English.

• Ability to evaluate AI responses objectively and provide actionable feedback.

• Willingness to work full-time on-site.

Preferred Qualifications

• Experience with AI agent platforms such as Dify, Coze, or n8n.

• Familiarity with Retrieval-Augmented Generation (RAG) and knowledge base management.

• Basic Python, SQL, or API knowledge.

• Experience with AI chatbots, conversational AI, customer service automation, or business process automation.

• Previous experience in BPO, technology, SaaS, or AI-driven business environments.

• Experience creating evaluation datasets and AI quality scoring frameworks.

What We Offer

• Opportunity to work with emerging generative AI technologies.

• Hands-on experience with AI agents and business automation solutions.

• Collaborative working environment with AI Engineers and operational teams.

• Professional development and career advancement opportunities.