Definition
Plain language
How far ahead the right answer's score is compared to the next-best contender.
As stated in the literature
The gap between the top logit and the runner-up logit; a margin exceeding twice the worst-case numerical perturbation per logit guarantees the argmax is invariant to that perturbation.
Also called: margins
Why it matters: A big enough margin means the chosen answer survives small numerical wobbles between machines or runs, so the same input reliably gives the same output.
For example, if the model scores the digit "7" at 8.2 and its closest rival "1" at 3.4, the margin is 4.8 and tiny rounding differences in the hardware cannot flip the answer.
Heard on the show
“More configurations than there are atoms in the observable universe, by an absurd margin.”Episode 002 — An AI Ran a Real Optics Lab for 21 Hours and Found a Transformer-Shaped Pattern in Light