Glossary · Term

fixed point

← all terms

Definition

Plain language

A value a process gets pulled toward — feed it in, get it back out.

As stated in the literature

A value x where f(x) = x; in iterative inference, the destination toward which a contractive map converges, allowing implicit solvers to skip explicit unrolling.

Also called: fixed-point, fixed-point iteration

Why it matters: Iterative procedures in neural networks often converge to fixed points, and finding them directly can replace expensive repeated forward passes.

For example, repeatedly hitting the square-root key on a calculator after entering any positive number converges to 1, which is the fixed point of the square-root function.

Heard on the show

“The omitted mass is a fixed point of review.”
Episode 233 — Why a Model Can Grade an Answer But Not Write the Answer Key

Mentioned in 7 episodes

  1. 233
    Why a Model Can Grade an Answer But Not Write the Answer Key
  2. 152
    Training a Model to Mean What It Says, And Why That Isn't the Same as Being Good
  3. 147
    Agents Fail at the Body, Not the Brain: A Self-Rewriting Scaffold That Lifts a 9B Model 44 Points
  4. 088
    Two Levers for Self-Improving AI: When Rewriting Code Isn't Enough
  5. 041
    When the Iteration Teaches the Model to Skip the Iteration
  6. 032
    A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
  7. 015
    The Audit Number Isn't What You Think: Sycophancy and the Case Against Single-Prompt Bias Tests

Related terms