Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Mercor

NewBe an early applicant

Remote Senior Software Engineer: AI Task Design & Review

Posted Updated

Description

Mercor is seeking a Senior Software Engineering Expert for a remote contract role, collaborating with AI research labs to craft and evaluate realistic engineering tasks. You will define tasks, verify realism, and create reference solutions.

Strong English writing and data-driven judgment are essential. Candidates should have 4+ years in software engineering and a Bachelor's from an English-speaking country, with proficiency in major languages such as Python, Java, C++, Go, TypeScript, or Rust.

Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation. Write clear task proposals explaining task realism, verification, and challenges for current AI models. Illustrate 'what good looks like' with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope. Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure. Apply consistent, evidence-based judgment for reproducible and defensible assessments. Take structured feedback from senior reviewers and iterate on submitted work. 4+ years of professional software engineering experience. Proficient in at least one major language (Python, Java, C++, Go, TypeScript, or Rust). Experience with large, complex production codebases and code quality judgment. Excellent written English for technical decisions and trade-offs. Bachelor's degree from an English-speaking country. Detail-oriented and consistent in evaluating complex work. Able to receive feedback and calibrate judgment to set standards.

Skills

What Senior Design jobs ask for — and how much of it you have →
Apply

See also

Design jobs by country — openings, pay and top skills →