Data Science Quality Architect for AI Evaluation

Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. You will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.

This role emphasizes independent judgment, reproducibility, and clear communication to executive stakeholders, with emphasis on