Remote Senior Software Engineer: AI Task Design & Review
Posted Updated
Description
Mercor is seeking a Senior Software Engineering Expert for a remote contract role, collaborating with AI research labs to craft and evaluate realistic engineering tasks. You will define tasks, verify realism, and create reference solutions.
Strong English writing and data-driven judgment are essential. Candidates should have 4+ years in software engineering and a Bachelor's from an English-speaking country, with proficiency in major languages such as Python, Java, C++, Go, TypeScript, or Rust.
Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation. Write clear task proposals explaining task realism, verification, and challenges for current AI models. Illustrate 'what good looks like' with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope. Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure. Apply consistent, evidence-based judgment for reproducible and defensible assessments. Take structured feedback from senior reviewers and iterate on submitted work. 4+ years of professional software engineering experience. Proficient in at least one major language (Python, Java, C++, Go, TypeScript, or Rust). Experience with large, complex production codebases and code quality judgment. Excellent written English for technical decisions and trade-offs. Bachelor's degree from an English-speaking country. Detail-oriented and consistent in evaluating complex work. Able to receive feedback and calibrate judgment to set standards.Skills
Sign in to read and join the discussion.