Glossary · Term

basin shift

← all terms

Definition

A sudden reorganization of a model's internal state that flips its answer between iterations.

In iterative/recurrent inference, a discrete event where a token's hidden state moves between qualitatively distinct attractor basins, causing a large change in the argmax output.

Also called: basin shifts

Mentioned in 1 episode

  1. 032
    A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking