freehire launches on Product Hunt on 26 August.

Follow →

Adjudicator (Disagreement Resolution + Guideline Governance)

Open 27d

Role : Adjudicator (Disagreement Resolution + Guideline Governance)

Location: India | Type: Full-time | Reports to: Quality Lead / Program Lead

Mission: Convert disagreement into defensible ground truth while continuously tightening the guideline system.


About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.


Responsibilities


Resolve label disagreements from multi-rater overlap and QA escalations.


Use side-by-side comparisons, guideline references, and evidence frames/clips to decide final truth.


Classify disagreement causes (definition ambiguity, visibility limits, procedural variance, annotator error).


Maintain adjudication logs and update guidelines/decision trees with approved changes.


Escalate to clinical reviewer when needed; prepare concise packets for decision.


Ensure adjudicated outputs feed back into training/calibration and pre-label improvement.

Requirements


5–10+ years in annotation operations with deep experience in complex labeling tasks.


Strong judgment and consistency; able to apply guidelines rigorously.


Excellent written communication; can document rationale cleanly.


Surgical/clinical familiarity preferred; clinician-in-the-loop experience is a plus.


KPIs


Adjudication turnaround time, repeat-disagreement reduction, guideline improvement rate, IRR uplift over time.


Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.


See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available