Definition
Plain language
A compressed, meaning-level description of something, rather than its raw pixels or words.
As stated in the literature
A vector in a model's learned representation space encoding semantic content; Orca predicts the next frame's latent (against a frozen vision encoder's embeddings) instead of reconstructing pixels.
Also called: latents
Why it matters: Working at the meaning level lets a model focus on what matters and predict how things change without getting bogged down in exact pixels or words.
For example, instead of storing every pixel of a photo of a beach, a latent might just capture 'sunny beach with two people and a boat.'
Heard on the show
“The correlation is latent in the predictor, not manufactured by the prompt.”Episode 234 — Two Copies of Gemini Cooperated in a Game Where Betrayal Always Pays