Software Engineer | $70/hr Remote
Posted
Summary
Contract role evaluating AI-powered developer tools: run structured evaluation assignments, grade technical correctness of outputs, build reproducible test environments with real commit histories and CI workflows, and troubleshoot multi-service integrations. Core stack: Git/GitHub, GitHub Actions CI/CD, Python/Bash, REST APIs and OAuth.
Position: Software Engineer
Type: Contract
Compensation: $50 - $70/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
- Execute structured evaluation assignments simulating developer activities using AI-powered tools.
- Assess and grade technical correctness of outputs within development environments.
- Design and maintain reproducible test environments with real commit histories and CI workflows.
- Configure and troubleshoot integrations across multiple software services for seamless connectivity.
- Investigate and document undocumented product behaviors through systematic testing.
- Participate in calibration sessions to ensure consistent evaluation methods.
Requirements
- Have strong relevant experience in software engineering with Git/GitHub workflows.
- Proficient with CI/CD systems, ideally GitHub Actions, and authoring custom workflows.
- Advanced scripting abilities in Python or Bash, with understanding of REST APIs and OAuth.
- Fluency with major enterprise SaaS platforms; administrative experience in cloud workspaces is advantageous.
- Experience leveraging AI assistants or agent tools in developer tasks is a plus.
- Background in technical QA, evaluation, or data annotation with consistency in applying rubrics.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage
Skills
Sign in to read and join the discussion.