Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

OpenTrain AI, Inc.

NewBe an early applicant

Remote ML Task Designer & AI Evaluation Engineer

Posted Updated

Description

OpenTrain AI, Inc. is seeking an AI Trainer (ML Engineering) and Task Designer to convert practical ML experience into structured technical tasks.

You will design tasks, prepare reproducible environments and reference solutions, and judge model outputs for correctness and reliability. Responsibilities include building evaluative rubrics, reviewing code and experiments, and ensuring submissions meet rigorous project specifications.

Create realistic ML engineering tasks for advanced AI systems. Build reproducible environments, reference solutions, rubrics and graders. Review model-generated Python code, experiments and analyses for quality. Identify data leakage, incorrect validation, instability and reproducibility issues. Assess technical submissions against project specifications and quality requirements. Expert-level practical machine learning experience with ability to set objective standards for solutions. Familiarity with constructing reproducible environments, reference solutions, rubrics and graders. Experience reviewing model-generated code and analyses for correctness and reliability. Ability to identify data leakage, validation issues, and training instability.

Skills

Apply

See also

Design jobs by country — openings, pay and top skills →