Definition
Plain language
A test where nothing happened — the thing being checked made no measurable difference.
As stated in the literature
An experimental condition producing no statistically or practically meaningful effect; valuable as a control when it rules out a competing explanation for an observed effect.
Also called: null results
Why it matters: Null results keep people from adopting defenses that only appear to work, and they rule out alternative explanations that would otherwise muddy a positive finding.
For example, a team tests whether adding a warning line to the system prompt reduces successful attacks and finds the attack rate is essentially unchanged.
Heard on the show
“One more null result worth a single line, since we're standing in front of the same photograph the whole time.”Episode 236 — Why a Printed 'OPERATOR OVERRIDE' Note Redirects Robot Planners