Glossary · Term

single-rater

← all terms

Definition

A study where only one person did the grading, without an independent check.

An evaluation setup in which a single human annotator scores all instances, limiting external calibration and introducing rater-specific bias.

Mentioned in 1 episode

  1. 044
    How One Sentence and a Forged History Flip the Most Aligned Models