AI Coding Agent Evaluator - Design & QA Real-World Tasks

Mindrift is seeking experienced software developers for project-based AI opportunities focusing on evaluating AI coding agents. You'll be tasked with building realistic development environments and designing challenging AI-related tasks.

Ideal candidates will have over 5 years of experience in software development, strong proficiency in Python and JavaScript frameworks, and a background in writing tests. Compensation is up to $40/hr based on experience and task completion speed.

Build realistic developer environments with a codebase and context. Design tasks and define acceptance criteria for evaluating AI agents. Write tests to verify the correctness of AI solutions. Iterate on tasks based on QA feedback. 5+ years in software development. Experience writing functional and integration tests. Proficient in English (B2+).