Research Engineer
You will build intelligent systems for infrastructure management by prototyping new approaches, running experiments, evaluating results, and bringing successful research into production. You will develop evaluation infrastructure, explore AI agent, machine learning, reasoning, retrieval, codebase mapping, and orchestration techniques, and collaborate with platform and product teams to create scalable services.
Responsibilities
- Run experiments across research areas
- Analyze results and validate successful approaches
- Take successful research approaches into production
- Build live and offline evaluation pipelines
- Create benchmarks and synthetic data
- Develop tooling for measuring progress
- Explore techniques for reasoning, retrieval, codebase mapping, and agent architectures
- Collaborate with platform and product teams
- Integrate capabilities into scalable and reliable services
Requirements
- 4+ years of experience in applied machine learning or research engineering
- Production experience with agentic and LLM systems
- Experience with multi-step reasoning, reinforcement learning, fine-tuning, and orchestration
- Experience bringing prototypes into production
- Knowledge of statistical modeling, probabilistic methods, time-series analysis, and evaluation methodology
- Expertise in an applied machine learning area such as search, statistical modeling, or natural language processing
- Experience building and running end-to-end evaluation pipelines with real-world data
- Proficiency in Python and TypeScript
- Experience with common machine learning libraries and data engineering tools
- Problem-solving skills focused on maintainable and scalable code
Benefits
- Equity grants
- Fully covered health insurance
- Fully covered dental insurance
- Fully covered vision insurance
- Retirement benefits
- Unlimited paid time off
- Dinner for late-night work
- Monthly fitness stipend
- Work equipment
- Citi Bike benefits
- Train benefits