Definition
Numerical margins are the gaps between the correct output’s logit and its closest competitor, compared against the worst-case error that finite-precision arithmetic can introduce. If the margin exceeds that error bound, fp16 rounding, accumulation order, or changes in batching cannot flip the predicted answer. Checking margins lets a verified or idealized result carry over to the floating-point implementation that actually runs, rather than holding only for exact real-number arithmetic.