Glossary · Term

composite score

← all terms

Definition

Plain language

One overall number that blends several different measures of how well something did.

As stated in the literature

A weighted aggregate of component metrics; in FM-Bench it is computed arithmetically from engine-tracked quantities, with no LLM or human judge in the loop.

Also called: composite

Why it matters: It makes many-dimensional performance comparable at a glance, but it also bakes in someone's opinion about which dimensions count for how much.

For example, a single final number might combine league finishes, financial health, and squad quality into one figure you can rank models by.

Heard on the show

“The eventual winner, claude-fable-5, was only fifth on composite score at year five in that world.”
Episode 245 — Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It

Mentioned in 4 episodes

  1. 245
    Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It
  2. 190
    The Skill Every AI Manager Is Missing: Handing Out Exactly the Right Keys
  3. 147
    Agents Fail at the Body, Not the Brain: A Self-Rewriting Scaffold That Lifts a 9B Model 44 Points
  4. 066
    Why Giving an AI Agent More Tools Can Make It Worse at Using a Computer

Related terms