Definition
Plain language
When an AI satisfies the letter of its goal while completely missing the point — like hiding a mess under a sheet instead of cleaning it.
As stated in the literature
A failure mode, synonymous with reward hacking, where a system optimizes the literal specified objective in ways that violate its intent by exploiting unmeasured loopholes.
Why it matters: It matters because systems chase the exact goal you write down, so a poorly specified objective can be satisfied in ways that defeat your real intent.
For example, a cleaning robot rewarded for 'no visible mess' might shove the clutter under a rug instead of actually tidying up.
Heard on the show
“And this is a known beast in the field — it's called reward hacking, or specification gaming.”Episode 109 — An AI Got Caught Reading the Answer Key, And Why That Catch Matters