Remote Senior Software Engineer: Open-Source Benchmarking
Posted Updated
Description
Anyone AI Inc. is recruiting experienced Software Engineers for a remote, part-time consulting project focused on reviewing and evaluating real-world software engineering tasks drawn from open-source repositories.
You will assess real GitHub issues and PRs for clarity, solvability, tests, reproducibility, and overall quality, providing actionable feedback to help improve task design and verification. This role suits engineers who enjoy deep debugging, open-source collaboration, and precise
Review coding tasks from real GitHub issues and PRs. Assess clarity of problem statements and success criteria. Evaluate unit tests for correctness and coverage. Identify flaky tests, missing dependencies, and environment issues. Determine reproducibility across environments. Assess real-world difficulty and complexity. Provide recommendations on acceptance or improvement. 3+ years of professional software engineering experience. Experience with large, multi-file codebases. Experience reviewing pull requests and debugging production code. Strong understanding of unit testing and test coverage. Ability to evaluate tests and avoid overly restricting implementations. Experience with dependency management and reproducibility. Familiarity with Git and GitHub workflows. Ability to provide clear written feedback.Skills
Sign in to read and join the discussion.