Senior Software Engineer – C# (LLM Evaluation & Repository Validation) | Job ID 37602
Posted
Summary
Remote ~3-month contractor role for a senior C# engineer doing LLM evaluation: triaging issues in public GitHub repos, setting up dev environments with Docker, and assessing unit-test quality and AI-assisted bug fixes. Requires 3+ years of C# plus Git/Docker; pays $15-$20/hour USD.
Vraify is hiring experienced C# software engineers for a remote contractor assignment focused on LLM evaluation and repository validation. The engagement is expected to last approximately 3 months; the start date is to be confirmed.
Eligible locations Applicants may be based in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Pakistan, Turkey, or Vietnam.
What you will do
- Analyze and triage issues in public GitHub repositories.
- Set up repositories and development environments, including Docker.
- Evaluate unit test coverage and quality, and run or modify code locally to assess AI-assisted bug fixing.
- Collaborate with researchers on challenging software engineering tasks; there may be opportunities to lead junior engineers.
What you bring
- At least 3 years of strong C# experience and the ability to contribute at a technical lead level.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to navigate, run, modify, and test complex real-world codebases.
- Experience with well-maintained, widely used public GitHub repositories, including repositories with 5,000+ stars.
- Open-source contributions, LLM evaluation, developer tools, or automation-agent experience are helpful.
Engagement and pay
- Remote contractor assignment for approximately 3 months, 40 hours per week, with 4 hours of daily overlap with Pacific time.
- Hourly pay: $15 USD for 2–4 years of experience or $20 USD for 4+ years of experience. The exact rate is confirmed during screening.
- Contractor benefits do not include medical coverage or paid leave.
- Shortlisted applicants complete an online coding assessment.