Machine Learning Evaluator | Remote
Posted Updated
Description
Crossing Hurdles is seeking Subject Matter Experts to evaluate machine learning model outputs on an hourly contract. You will rate AI responses for accuracy and relevance and provide written justifications for scores.
The work is remote and expected to require about five hours, completed asynchronously. The ideal candidate has strong analytical skills, attention to detail, and experience reading and evaluating technical research content.
Review ML model outputs in response to research prompts. Rate AI responses for accuracy, relevance, and factual correctness using a structured system. Provide clear written justifications for evaluation scores. Proven ability to evaluate complex technical or research content. Strong analytical and critical thinking abilities are essential. Detail-oriented with the ability to justify evaluation scores in writing. ML PhD researchers published in top venues are encouraged to apply.Skills
Sign in to read and join the discussion.