Definition
Plain language
The huge number of rare items — obscure events, niche software, uncommon words — that each show up almost never but together add up to a lot.
As stated in the literature
The low-frequency region of a heavy-tailed or power-law distribution; long-tail tasks, software, and events are used to stress-test agents because their rarity defeats memorization and forces genuine retrieval or generalization.
Also called: long-tail, long-tailed
Why it matters: Systems that look great on common cases can still fail users badly on rare ones, so the long tail is where real-world robustness gets tested.
For example, a search engine handles 'weather' constantly, but together the millions of one-off oddball queries it sees each day make up a big share of all searches.
Heard on the show
“… On compositional tool use, the base distribution contains a long tail of strategies whose downstream reasoning would solve the problem if only it got picked more often …”Episode 011 — When RL Actually Teaches Agents Something New, And When It Doesn't