Senior Python Engineer - AI Agent Evaluation & Testing

Mindrift is building a dataset to evaluate AI coding agents for real-world developer tasks. You will craft tasks within realistic simulated environments, designing prompts, success criteria, and solvability for AI agents.

You will define tests that accept multiple valid solutions and iterate based on QA feedback. The role involves contributing code and evaluation strategies, writing robust tests, and collaborating with teams on task design.