freehire launches on Product Hunt on 26 August.

Follow →

Machine Learning Engineer Graduate (Agent Evaluation & Evolution) - 2027 Start

Summary

Build and evaluate LLM-based agent systems by analyzing execution traces, automating scoring, and designing benchmark pipelines to improve agent capabilities.

- Analyze agent execution traces - Automate judging with model based scoring - Build benchmark pipelines - Collaborate with research platform and product teams to deploy methods - Design LLM agent evaluation systems - Incorporate user feedback into system improvements - Support closed loop experience to capability

See also