Software Engineer AI Evaluation & Automation
Posted Updated 1
view
Summary
Remote 12-month contract role building and scaling tooling that measures how well AI-powered software development tools perform — developing evaluation harnesses, automating benchmark runs, and making results reproducible.
Software Engineer —AI Evaluation & Automation Remote 12 Months contract Role Overview Help build and scale the tooling we use to measure how well AI-powered software development tools actually perform. You'll develop evaluation harnesses, automate benchmark runs, and help make sure the results we produce are reproducible and hold up to scrutiny. This is an engineering role, but a lot of the work is about getting the measurement right, not just automating it. Key Responsibilities • Build and int…