Definition
Plain language
An earlier method that taught AI models to reason in their own internal vectors instead of writing the reasoning out in words.
As stated in the literature
A continuous-latent reasoning approach (Chain of Continuous Thought) where a model reasons in hidden-state vectors rather than tokens; MIRAGE builds on it and replaces its serial latent computation with parallel refinement.
Why it matters: It showed that models can reason in their own internal representations instead of words, opening the door to faster thinking that isn't slowed by writing every step out.
For example, rather than typing out 'first I add these, then I carry the one,' a Coconut-style model holds those steps as internal number-vectors and only writes the final answer.
Heard on the show
“It came from a paper called Coconut, last year.”Episode 141 — How Two Tokens Reopened a Reasoning Method the Field Had Given Up On