Glossary · Term

lookahead

← all terms

Definition

Plain language

Peeking at what's coming later before committing to a choice now.

As stated in the literature

Conditioning a decision on future candidates or states rather than only the prefix already produced; standard left-to-right decoding has none.

Why it matters: Without lookahead, a model cannot tell whether a list it is halfway through will end up complete, so it has no basis for deciding when to stop.

For example, a chess player who considers three possible replies before moving is using lookahead, while a model writing text left to right commits to each word before seeing what follows.

Heard on the show

“And when they test exactly that regime, the greedy selector's margin over a smarter two-step lookahead shrinks from about one-and-a-half points down to a third of a point.”
Episode 162 — The Empty-Lake Proof: Why More Rollouts Stop Helping Reasoning Models

Related terms