Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Micro1

AI Agent Evaluator

Posted Updated

Description

**Pay:** $25-$45 per hour (USD). **Role Title: AI Agent Evaluator** **Role Type: Contractor** **Location:** Remote — U.S Based #### Opportunity Snapshot **Pay:** $25-45/hour **Time per task:** ~1.5 hours per run (evidence and scoring included) **Onboarding:** Once you are presented to the hiring manager, onboarding typically takes 24–48 hours before you can start tasking. **You’ll need:** An active personal popular AI account (Free, Go, or Plus, Pro), an active personal and a smartphone that can screen record **Your tasks:** Run everyday errands with two AI agents, approve key steps, screen record, and score the results #### About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you. You’ll test **two AI agents** side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt. #### What you’ll do 1. Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms 2. Approve or stop the agent at key steps 3. Screen record every attempt 4. Score each run on **completion, quality, control issues, satisfaction, and time** 5. Share clear written feedback on the agent experience #### Who we’re looking for 1. **Based in the U.S,** with a bachelor’s degree. 2. Someone who already uses **AI in daily life** 3. **2-3 years** of experience, preferably in engineering, business management, or office/operations 4. Detail-oriented, great at following instructions and documenting each step 5. Clear written communication 6. Generalists welcome, domain experts preferred 7. No coding or AI background needed #### Why you’ll like it 1. Get paid to use the AI tools you already use 2. Work entirely from your phone, on your schedule 3. Have a direct say in how next-generation AI agents get built and improved #### How the selection process works 1. **Apply** 2. **Complete the screening questions** 3. **Interview**: 15-30 minutes max 4. **Profile review:** if everything looks good, we present you to the client 5. **Onboarding:** our Talent Ops team will contact you to get you started

Skills

Apply

See also