Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Posted Updated
Description
Liftedanupworkcompany is seeking a senior Python engineer for a fully remote contract focused on AI model evaluation and benchmarking. You will design benchmarks, review AI-generated code, and build data pipelines to support evaluation workflows.
The role requires expert Python skills, experience with CI/CD and automated testing, and the ability to work across multi-language codebases. Expect 10–39 hours per week with weekly payments in USD.
Design and develop coding benchmarks to evaluate frontier AI models. Analyze AI-generated code for correctness, reliability, efficiency, and edge cases. Build and maintain scalable data pipelines that support AI evaluation workflows. Create structured programming scenarios to test reasoning, debugging, and code quality. Work with large codebases and multi-language software environments. Collaborate with teams focused on improving how AI models understand, generate, and evaluate software. Write clean, maintainable, and well-tested Python code following software engineering best practices. 4+ years of professional software engineering experience. Expert-level proficiency in Python. Experience at a high-growth technology company or top-tier software organization. Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar. Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit. Strong understanding of software engineering best practices, debugging, and code quality. Excellent analytical and problem-solving skills.Skills
Sign in to read and join the discussion.