Glossary · Term

equivalence margin

← all terms

Definition

Plain language

How small a difference has to be before you'll call two things the same.

As stated in the literature

The pre-specified bound in an equivalence test; the null of non-equivalence is rejected when the confidence interval for the difference falls entirely inside the margin.

Also called: margin

Why it matters: Without setting this bound ahead of time, "we found no difference" can mean anything from a genuinely identical result to a study too small to detect a large one.

For example, researchers might decide in advance that if two conditions differ by less than five percentage points, they will treat the conditions as performing the same.

Heard on the show

“A probe trained to detect sycophancy on the original model still transfers to lying detection on the post-training model, within the equivalence margin he pre-specified.”
Episode 004 — The Sycophancy Circuit That Survives Alignment Training

Related terms