Definition
Plain language
A function that pulls things closer together each time you apply it, so iteration converges.
As stated in the literature
A property of a map under which repeated application contracts distances, guaranteeing convergence to a fixed point.
Why it matters: Contractive maps are the mathematical foundation for many iterative algorithms used in optimization, equation solving, and equilibrium-style neural networks.
For example, repeatedly averaging a number with zero halves it each time, contracting toward a fixed point of zero.
Heard on the show
“" If the refinement step is contractive — if every iteration pulls things closer together — then that inverse is well-behaved, and the gradient is finite.”Episode 041 — When the Iteration Teaches the Model to Skip the Iteration