contractive

Definition

A function that pulls things closer together each time you apply it, so iteration converges.

A property of a map under which repeated application contracts distances, guaranteeing convergence to a fixed point.

Mentioned in 2 episodes

1. 041
   When the Iteration Teaches the Model to Skip the Iteration
2. 032
   A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking