Glossary · Term

effect size

← all terms

Definition

Plain language

A number that says not just whether a difference is real, but how big it is.

As stated in the literature

A standardized measure of the magnitude of an observed difference or relationship (e.g., Cohen's d, correlation coefficient), independent of sample size; distinguishes practically meaningful effects from statistically detectable but trivial ones.

Also called: effect sizes

Why it matters: It stops people from getting excited about differences that are technically detectable but too small to make any practical difference.

For example, a new tutoring method might raise test scores by a tiny sliver that shows up in a huge study, and the effect size tells you that sliver is too small to bother with in a real classroom.

Heard on the show

“The agents matched humans on effect sizes and blew right past them on confidence.”
Episode 196 — AI Agents Reached Opposite Conclusions From the Same Data — and Passed Review

Mentioned in 6 episodes

  1. 196
    AI Agents Reached Opposite Conclusions From the Same Data — and Passed Review
  2. 110
    How an Agent Got 44 Points Better by Mining Its Own Scratch Paper
  3. 108
    The Reasoning Cliff: Why Thinking Longer Makes Models Worse at Exact Step-by-Step Tasks
  4. 095
    Seven Wins to Zero: How Organizing AI Agents Like a Lab Changes the Search
  5. 070
    When Models Know the Answer But Say the Wrong Thing Anyway
  6. 011
    When RL Actually Teaches Agents Something New, And When It Doesn't