Definition
Plain language
An early tiny-reasoner model architecture for puzzle-solving via iterative latent refinement.
As stated in the literature
Hierarchical Reasoning Module, a small recurrent architecture for structured reasoning tasks, prior art for attractor-style and looped reasoners; also used as the basis of HRM-Text's two-module fast/slow language model design.
Also called: HRM-Text
Why it matters: It's a precursor to current interest in small, looped reasoning models that try to compete with large transformers via depth rather than width.
For example, HRM was an early demonstration that a small recurrent model could solve ARC-style puzzles by iteratively refining a hidden representation.
Heard on the show
“Then they swap in the HRM architecture — sixty-one.”Episode 074 — How a Fifteen-Hundred-Dollar Training Run Matched Llama and Gemma on Reasoning