Glossary · Term

Louver

← all terms

Definition

Plain language

An index that uses geometry to skip over irrelevant past tokens during attention.

As stated in the literature

A halfspace-range-searching-based attention sparsification system using bounding-ball pruning across factored subspaces, with completeness guarantees above a threshold and constant-memory index state.

Why it matters: It promises long-context attention with full-attention-quality recall but at a fraction of the compute and memory.

For example, when computing attention for a new token, Louver geometrically rules out distant past tokens that couldn't possibly score high enough to matter, avoiding most dot products.

Mentioned in 1 episode

  1. 036
    Sparse Attention Was the Wrong Frame. Treat It as Geometry Instead.

Related terms