AI Coding Agent Evaluator & Task Designer
Summary
Designs and evaluates realistic coding tasks to test AI coding agents, requiring deep software development knowledge and strong Python/JavaScript skills.
AI Chopping Block, located in Romblon, España, is looking for experienced software developers to help build a dataset for evaluating AI coding agents. This project focuses on creating realistic tasks and environments that challenge AI models and require deep understanding of software development principles.
Applicants should have over 5 years of experience, proficiency in Python and JavaScript, and strong test writing skills. Compensation is project-based at up to $40/hr depending on experience and performance.