Glossary · Term

attractor basin

← all terms

Definition

Plain language

A region of a model's possible internal states that pulls nearby states toward a common settled point.

As stated in the literature

In iterative or recurrent inference, a region of state space whose dynamics converge to a single fixed point, used to describe regimes where a token's hidden state stays stable across iterations.

Also called: basin, attractor basins

Why it matters: Understanding attractor basins explains why iterative models converge to stable answers — and why a small nudge can sometimes flip them dramatically.

For example, once a token's hidden state lands in a 'this is a question' basin, repeated refinement keeps pulling it back to the same configuration.

Heard on the show

“… arrangement, they jumped to a qualitatively new geometric arrangement — the paper calls it a new basin — and the penalty dropped by two orders of magnitude in one move. …”
Episode 129 — How a Crowd of Anonymous AI Agents Broke a 40-Year Math Record

Mentioned in 3 episodes

  1. 129
    How a Crowd of Anonymous AI Agents Broke a 40-Year Math Record
  2. 073
    When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
  3. 032
    A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking

Related terms