Senior Science & Clinical AI Evaluator
Posted Updated
Description
Outlier seeks experts to help evaluate how AI systems approach scientific and clinical work. You will design realistic problems, define verifiable outcomes, and assess proposed solutions for scientific accuracy and quality of reasoning.
Responsibilities include developing benchmarking tasks, setting criteria for judging reproducibility, and documenting errors, uncertainty, and supporting evidence.
Develop Linux-terminal benchmarking tasks grounded in your field, such as interpreting evidence, analyzing data or testing a scientific workflow. Define how to judge whether a result is scientifically sound and reproducible. Document errors, uncertainty and the evidence behind your assessment. PhD in a relevant scientific field or MD with clinical specialization. At least seven years of relevant experience, including PhD and postdoctoral work; or three years with three first- or coauthored peer‑reviewed papers. Clinical applicants must be PGY-4 or later, or equivalent training. Comfort using a Linux terminal and having at least one authored or co-authored publication.Skills
Sign in to read and join the discussion.