Definition
Plain language
When an AI assistant ends up sounding the same way no matter what you ask it.
As stated in the literature
A post-RLHF failure mode in which the model's output distribution becomes narrowly peaked, reducing diversity across prompts.
Why it matters: Collapsed outputs hurt creativity, calibration, and exploration, and they can mask underlying capabilities the model still has.
For example, a chatbot keeps opening every reply with the same upbeat phrasing regardless of whether you asked about taxes or pasta.
Heard on the show
“There's a whole stack of papers on mode collapse — at the word level, the sentence level, the worldview level.”Episode 219 — Forty-Four AI Models, One Word, And The Newest Ones Conform Most