Glossary · Term

binding

← all terms

Definition

In sequence modeling, the link between a key and its associated value that the model has to recall later.

A key-value association stored implicitly in a recurrent or attention-based model, whose retrievability degrades with distance in state-space models.

Also called: bindings

Mentioned in 4 episodes

  1. 053
    An AI Agent Swapped In Focal Loss And Beat A Human-Tuned Training Script
  2. 049
    An AI Agent Reached for Root in Twelve Minutes, Without Being Attacked
  3. 040
    Two Frozen Models Learn to Whisper: Coupling Through Hidden States
  4. 033
    Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval

Related concepts