Glossary · Term

standard deviation

← all terms

Definition

Plain language

The typical amount a set of numbers wanders away from their average.

As stated in the literature

The square root of the variance; used here as the natural unit for comparing accidental prompt-induced wobble against deliberately optimized steering range.

Why it matters: It gives a common yardstick for comparing how much something wobbles by accident against how far it can be pushed on purpose.

For example, if test scores mostly land within five points either side of the average, the standard deviation is about five.

Heard on the show

“One model has a standard deviation of nearly twenty-three on a mean of thirty-seven.”
Episode 245 — Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It

Mentioned in 7 episodes

  1. 245
    Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It
  2. 243
    How a Hundred Meaningless Word Choices Add Up to Flip a Model's Answer
  3. 193
    Freeze Most of the Network: Where RL Improvement Actually Lives in a Transformer
  4. 162
    The Empty-Lake Proof: Why More Rollouts Stop Helping Reasoning Models
  5. 151
    Why More Experience Made This AI Agent Worse, And How to Fix It
  6. 148
    Why Letting an AI Watch Its Own Scoreboard Can Quietly Overwrite Its Safety
  7. 112
    When an AI Agent Cheats Without Being Told: Inside the Meta-Agent Challenge

Related terms