Software Engineer, RL Environments
Posted 8
views
Summary
Build Python software for reinforcement learning environments and ML model evaluation on an applied AI research team. Day to day, you design data collection strategies, evaluation rubrics, and data slices that surface model failure modes across finance, code, and enterprise workflows, working on-site in San Francisco.
About the Role
Join an applied AI research team building reinforcement learning environments and evaluation resources for machine learning models. In this role, you will use Python and thoughtful data design to help models perform more reliably across complex, real-world domains.
What You'll Do- Develop Python software that supports reinforcement learning environment work and model evaluation.
- Design data collection strategies and evaluation rubrics for machine learning models.
- Create data slices that help surface model failure modes across finance, code, and enterprise workflows.
- Help turn nuanced evaluation needs into structured data and assessment approaches that can be used to improve model performance.
- One to four years of hands-on experience designing data collection strategies and evaluation rubrics for machine learning models.
- Experience using Python for software development.
- Background identifying model failure modes through evaluation across multiple domains, such as finance, code, or enterprise workflows.
The salary range is $260,000 to $290,000 annually. Visa sponsorship is available.
LocationThis is an on-site role based in San Francisco, California.
