Definition
Plain language
A value a process gets pulled toward — feed it in, get it back out.
As stated in the literature
A value x where f(x) = x; in iterative inference, the destination toward which a contractive map converges, allowing implicit solvers to skip explicit unrolling.
Also called: fixed-point, fixed-point iteration
Why it matters: Iterative procedures in neural networks often converge to fixed points, and finding them directly can replace expensive repeated forward passes.
For example, repeatedly hitting the square-root key on a calculator after entering any positive number converges to 1, which is the fixed point of the square-root function.
Heard on the show
“The collapse to a trivial fixed point — and it's the most important practical lesson in the paper.”Episode 152 — Training a Model to Mean What It Says, And Why That Isn't the Same as Being Good