QA review and adjudication · Remote, United States · Freelance

Review annotated and transcribed batches against acceptance criteria, adjudicate disagreements and help calibrate annotator agreement. Remote freelance, paid per hour.

The work

• Score batches against the project rubric and document decisions.
• Adjudicate conflicting labels and give concrete feedback.
• Flag guideline gaps so instructions improve.

You need

• Prior annotation, transcription or review experience.
• Structured, consistent judgment and clear written feedback.
• 18 years or older.