attractor basin

Definition

A region of a model's possible internal states that pulls nearby states toward a common settled point.

In iterative or recurrent inference, a region of state space whose dynamics converge to a single fixed point, used to describe regimes where a token's hidden state stays stable across iterations.

Also called: basin, attractor basins

Mentioned in 2 episodes

1. 073
   When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
2. 032
   A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking