Research Engineer, Infrastructure
Posted Updated
Description
You will own the infrastructure behind Harvey's post-training effort: distributed training, RL rollout systems, agent environments and internal tools for data, evals and training jobs. You'll remove bottlenecks, improve reliability and integrate models into production.
Responsibilities
- Scale the post-training stack supporting SFT and RL on open-weight models
- Build distributed rollout infrastructure for inference, tool execution and experience collection
- Build reproducible agent environments for training and evaluation
- Own performance and reliability of training runs including GPU utilization, checkpointing, failure recovery and observability
- Identify and remove bottlenecks across training and inference
- Build internal tools for data management, evals and training job tracking
- Integrate models into production including serving, latency, cost and online evaluation
- Partner with researchers to turn experimental workflows into dependable systems
Requirements
- Experience building ML infrastructure, distributed systems or research tooling
- Strong Python and generalist software engineering skills with PyTorch, JAX or similar frameworks
- Experience with distributed training or inference and diagnosing bottlenecks
- Understanding of post-training workflows; RL rollouts, agent environments or sandboxed tool execution a plus
- Judgment on build versus adopt
Benefits
- Equity
Skills
Sign in to read and join the discussion.