Contract AI Evaluation Engineer - Design & Test Coding
Summary
Designs and tests coding challenges for AI agents, writing Python/JS tasks and verifying solutions in simulated developer environments.
Mindrift is building a dataset to evaluate AI coding agents for leading tech companies, focusing on testing, evaluating, and improving AI systems. The role involves creating challenging tasks within simulated developer environments and writing tests to verify agent solutions.
Participation is project-based, not permanent employment, and compensation is up to $50/hr equivalent depending on level and pace. Strong Python/JS tech stack experience and English proficiency are required.