Glossary · Term

memory cliff

← all terms

Definition

The sudden collapse in accuracy when a state-space model's running summary can no longer hold a needed fact.

The empirical phenomenon in state-space models where recall accuracy abruptly drops to chance once the gap between a stored binding and its retrieval exceeds the recurrent state's effective horizon.

Mentioned in 1 episode

  1. 033
    Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval