Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Outlier

NewBe an early applicant

Senior Science & Clinical AI Evaluator

Posted Updated

Description

Outlier seeks experts to help evaluate how AI systems approach scientific and clinical work. You will design realistic problems, define verifiable outcomes, and assess proposed solutions for scientific accuracy and quality of reasoning.

Responsibilities include developing benchmarking tasks, setting criteria for judging reproducibility, and documenting errors, uncertainty, and supporting evidence.

Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow. Define how to judge whether a result is scientifically sound and reproducible. Document errors, uncertainty and the evidence behind your assessment. PhD in a relevant scientific field or MD with clinical specialization. At least seven years of relevant experience, including PhD and postdoctoral work; or three years with three first- or coauthored peer‑reviewed papers. Clinical applicants must be PGY-4 or later, or equivalent training. Comfort using a Linux terminal and having at least one authored or co-authored publication.

Skills

Apply

Other locations (2)

See also