Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Liftedanupworkcompany

Copy of Senior Python Developer (AI Evaluation & Benchmarking)

Posted Updated

Description

Liftedanupworkcompany is seeking a senior Python engineer for a fully remote contract focused on AI model evaluation and benchmarking. You will design benchmarks, review AI-generated code, and build data pipelines to support evaluation workflows.

The role requires expert Python skills, experience with CI/CD and automated testing, and the ability to work across multi-language codebases. Expect 10–39 hours per week with weekly payments in USD.

Design and develop coding benchmarks to evaluate frontier AI models. Analyze AI-generated code for correctness, reliability, efficiency, and edge cases. Build and maintain scalable data pipelines that support AI evaluation workflows. Create structured programming scenarios to test reasoning, debugging, and code quality. Work with large codebases and multi-language software environments. Collaborate with teams focused on improving how AI models understand, generate, and evaluate software. Write clean, maintainable, and well-tested Python code following software engineering best practices. 4+ years of professional software engineering experience. Expert-level proficiency in Python. Experience at a high-growth technology company or top-tier software organization. Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar. Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit. Strong understanding of software engineering best practices, debugging, and code quality. Excellent analytical and problem-solving skills.

Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

See also

Software Engineering jobs by country — openings, pay and top skills →