autoregressive

Definition

Generating one word at a time, with each word depending on what came before.

A generation regime where the model predicts each token conditional on the sequence of previously generated tokens.

Also called: autoregressively

Mentioned in 3 episodes

1. 074
   How a Fifteen-Hundred-Dollar Training Run Matched Llama and Gemma on Reasoning
2. 032
   A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
3. 027
   When AI Agents Build the Serving Stack: A Bet on Bespoke Infrastructure

Related concepts