Remote ML Task Designer & AI Evaluation Engineer
Posted Updated
Description
OpenTrain AI, Inc. is seeking an AI Trainer (ML Engineering) and Task Designer to convert practical ML experience into structured technical tasks.
You will design tasks, prepare reproducible environments and reference solutions, and judge model outputs for correctness and reliability. Responsibilities include building evaluative rubrics, reviewing code and experiments, and ensuring submissions meet rigorous project specifications.
Create realistic ML engineering tasks for advanced AI systems. Build reproducible environments, reference solutions, rubrics and graders. Review model-generated Python code, experiments and analyses for quality. Identify data leakage, incorrect validation, instability and reproducibility issues. Assess technical submissions against project specifications and quality requirements. Expert-level practical machine learning experience with ability to set objective standards for solutions. Familiarity with constructing reproducible environments, reference solutions, rubrics and graders. Experience reviewing model-generated code and analyses for correctness and reliability. Ability to identify data leakage, validation issues, and training instability.Skills
Sign in to read and join the discussion.