Language Expert (Korean) for AI Evaluation
Posted
Description
The work
- Review and rank AI-generated responses for correctness, fluency, and relevance to the context.
- Evaluate step-by-step reasoning, identify methodological or conceptual errors, and check whether responses follow the prompt.
- Write clear explanations and model solutions that show correct methods when needed.
- Apply Korean localization judgment across terminology, style, tone, cultural nuance, and South Korea locale conventions.
- Use MQM, LQA, and terminology judgment across different use cases.
- Fact-check localized content, including units, references, names, and dates.
- Compare multiple AI model responses and assess their quality.
- Pay: Up to $25 to $40 per hour.
- Time: 20+ hours per week.
- Work type: Part-time contractor work with an hourly pay structure.
- Location: Open to candidates in Australia, Canada, China, Japan, South Korea, and the United States.
- Language: Fluent Korean and at least C1 English reading and writing proficiency.
- Experience: Expert-level background in translation, localization, or linguistic quality assurance.
- Tools and workflows: Experience with computer-assisted translation tools, quality assurance workflows, termbases, or translation memories.
- Work standards: Strong attention to detail, sound editorial judgment, consistent evaluation standards, clear documentation, and dependable work as a contractor.
- Preferred: Previous experience in AI data training, annotation, or evaluation.
- Collaboration: Comfortable working with people across time zones.
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training workAI training is the human work behind systems that generate and understand language. Contributors review examples, rate model responses, and write better examples so AI systems become more accurate and useful; specialized language and evaluation experience is valuable because it supports careful, reliable judgments.
Sign in to read and join the discussion.