Definition
Plain language
Looking up a value when you know its key, even if many other things sit in between.
As stated in the literature
The task of retrieving a value bound to a given key from earlier in a context, used as a stress test for long-context modeling architectures.
Why it matters: It's the cleanest stress test for whether a long-context model can actually retrieve information from far back, and a famous weakness of state-space models.
For example, an associative recall test plants 'the password is hippopotamus' near the start of a long document and later asks 'what is the password?'.
Heard on the show
“It came out of the Zoology paper from Arora and colleagues, constructed specifically to crystallize "state-space models can't do associative recall.”Episode 033 — Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval