Definition
Plain language
A public ranking that lists which AI models score best on various tests.
As stated in the literature
A ranked table of models by benchmark or human-preference scores; often steers adoption and is vulnerable to contamination and presentation effects.
Also called: leaderboards
Why it matters: It shapes which models people trust and adopt, which is why misleading or gamed rankings can steer the whole field in the wrong direction.
For example, a reader deciding which AI model to try might first check where each one sits on a public leaderboard.
Heard on the show
“… Trajectories," and the reason that ten-thousand-example result is interesting isn't that it's a leaderboard upset — it's that it's an argument about what the industrial pipeline was actually doing. …”Episode 021 — Ten Thousand Examples Beat the Full Industrial Pipeline for Search Agents