Definition
Plain language
A research dataset where human experts, not AIs, score political parties on things like immigration, LGBT equality, and economic left-versus-right.
As stated in the literature
An expert-coded political-science dataset scoring parties across ideology dimensions; used as an independent, non-model ground truth for politicians' ideological positions.
Also called: V-Party dataset
Why it matters: It matters because having human experts independently score parties' positions gives a trustworthy yardstick to check whether an AI's political judgments line up with reality.
For example, V-Party might record that a given party scores high on restricting immigration and low on LGBT equality, based on ratings from political-science experts rather than a model.
Heard on the show
“It's called V-Party, a dataset where human experts, not models, score political parties on things like immigration, LGBT equality, secularism, and economic left-versus-right.”Episode 223 — When Grok Graded Its Own Encyclopedia And Marked Itself Down