recurrent

Definition

Processing a sequence step by step, with the model carrying a hidden state from one step to the next.

A computational pattern that maintains and updates a state across sequence positions, contrasted with parallel attention-based processing.

Also called: recurrence, recurrences, recurrent state

Mentioned in 8 episodes

1. 074
   How a Fifteen-Hundred-Dollar Training Run Matched Llama and Gemma on Reasoning
2. 073
   When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
3. 048
   How a 30B Open Model Reached Olympiad Gold With the Right Recipe
4. 041
   When the Iteration Teaches the Model to Skip the Iteration
5. 040
   Two Frozen Models Learn to Whisper: Coupling Through Hidden States
6. 033
   Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval
7. 032
   A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
8. 027
   When AI Agents Build the Serving Stack: A Bet on Bespoke Infrastructure