Research Program Manager Model Evaluations and Safety
Posted 3
views
Summary
Reflection is hiring a Research Program Manager to stand up its model evaluation and safety operations from scratch — defining eval frameworks and safety workflows, embedding safety checkpoints into model development and releases, and coordinating external safety partners. It is a technical program-management role at an AI research company, not a hands-on coding job.
You will establish model evaluation and safety operations from the ground up. You will define evaluation frameworks and workflows, embed safety checkpoints into development, prioritize investments, coordinate external safety engagement, report model risks, and improve processes through post-mortems.
Responsibilities
- Build infrastructure for model evaluations and safety
- Define evaluation frameworks, tooling requirements, and operational processes
- Establish model safety workflows, review cadences, and decision frameworks
- Embed safety and evaluation checkpoints in model development and release processes
- Prioritize evaluation science and infrastructure investments
- Coordinate third-party assessments, academic partnerships, and industry safety frameworks
- Report model safety status, evaluation coverage, and open risks
- Champion blameless post-mortems and continuous learning
Requirements
- 7+ years of experience in technical program management, research operations, or ML engineering
- Experience establishing new functions, teams, or programs
- Knowledge of model evaluation, AI safety, red-teaming, alignment research, and safety regulation
- Knowledge of model behavior, evaluation design, data pipelines, and safety-critical system architecture
- Experience creating programs with ownership, measurable outcomes, and durable processes
- Technical stakeholder and external partner management
Benefits
- Equity
- Stock options
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Annual wellness allowance
- Daily office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 days of vacation in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations
