Glossary · Term

scoring function

← all terms

Definition

Plain language

The formula that decides how many points a run is worth.

As stated in the literature

The explicit objective used to grade agent behavior; its weights encode designer opinions (e.g. discounting idle cash), so behavioral correlations partly measure agreement with the benchmark's preferences rather than universal competence.

Also called: scoring functions

Why it matters: Because the formula encodes the designers' opinions, a high score partly measures agreement with those opinions rather than skill in any absolute sense.

For example, a benchmark that docks points for holding too much idle cash will rank a cautious saver below a spender, even if saving was reasonable.

Heard on the show

“Idle cash shows up as the second-strongest correlate because the scoring function penalizes idle cash — cash above three times wages counts at thirty cents.”
Episode 245 — Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It

Mentioned in 7 episodes

  1. 245
    Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It
  2. 199
    Finding a Model's Hidden Behaviors Without Knowing What You're Looking For
  3. 178
    How an AI Reviewer Learned to Stop Going Easy on AI Writing
  4. 129
    How a Crowd of Anonymous AI Agents Broke a 40-Year Math Record
  5. 093
    A Calibrated Knob for Weak-to-Strong AI Oversight, Tested on Real Code
  6. 089
    When AI-Written Papers Read Well But the Evidence Underneath Is Broken
  7. 046
    When the AI Optimizer Edits the Grade Book: Why Harnessing Evolution Needs a Wall

Related terms