Glossary · Term

mode collapse

← all terms

Definition

Plain language

When an AI assistant ends up sounding the same way no matter what you ask it.

As stated in the literature

A post-RLHF failure mode in which the model's output distribution becomes narrowly peaked, reducing diversity across prompts.

Why it matters: Collapsed outputs hurt creativity, calibration, and exploration, and they can mask underlying capabilities the model still has.

For example, a chatbot keeps opening every reply with the same upbeat phrasing regardless of whether you asked about taxes or pasta.

Heard on the show

“There's a whole stack of papers on mode collapse — at the word level, the sentence level, the worldview level.”
Episode 219 — Forty-Four AI Models, One Word, And The Newest Ones Conform Most

Mentioned in 3 episodes

  1. 219
    Forty-Four AI Models, One Word, And The Newest Ones Conform Most
  2. 070
    When Models Know the Answer But Say the Wrong Thing Anyway
  3. 019
    When the Best Reward Model Trains the Worst Policy: Inside EvoLM

Related terms