Glossary · Term

in-distribution

← all terms

Definition

Plain language

Data that looks like the examples a system was trained on, so it handles it reliably.

As stated in the literature

Inputs drawn from the same distribution as a model's training data, where its calibration and accuracy hold; contrasted with out-of-distribution inputs that fall in blind spots.

Also called: in distribution

Why it matters: Systems tend to be accurate and confident on in-distribution data but stumble on anything unfamiliar, so knowing the boundary tells you where to trust the output.

For example, a model trained only on photos of cats and dogs handles a new cat photo reliably because it falls within what it has already seen.

Heard on the show

“Their line for it: the in-distribution accuracy and the fool rate are the same number twice, in opposite directions.”
Episode 220 — Write Like It's 1923: The One-Prompt Trick That Beats AI Detectors

Mentioned in 10 episodes

  1. 220
    Write Like It's 1923: The One-Prompt Trick That Beats AI Detectors
  2. 206
    How Four-Second Clips Become Hours of Playable AI Soccer
  3. 140
    When a Reasoning Model Says "Let Me Double-Check" After It's Already Decided
  4. 091
    When Better Fine-Tuning Can't Help: A Geometric Impossibility in LLM Causal Reasoning
  5. 084
    Terminal Agents Get Free Supervision From The Tokens We've Been Throwing Away
  6. 080
    How a Two-Agent Trick Unlocked Large-Scale Training for Computer-Use Agents
  7. 059
    Firefly's Inversion: Building Verified Tool-Call Training Data by Working Backward
  8. 047
    When Agent Benchmarks Lie: The Harness Problem in Open-Source AI
  9. 022
    Training the Model Spec Directly: An Alignment Lever Aimed at the Say-Do Gap
  10. 009
    How Two Silent Library Bugs Quietly Invalidated a Wave of Reasoning Papers

Related concepts

Related terms