Glossary · Term

LAMBADA

← all terms

Definition

A benchmark that tests whether a model can predict the last word of a passage that requires understanding the whole context.

A long-context word prediction benchmark requiring broad discourse understanding; a standard zero-shot evaluation for pretrained language models.

Also called: Lambada

Mentioned in 2 episodes

  1. 041
    When the Iteration Teaches the Model to Skip the Iteration
  2. 033
    Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval