Definition
Plain language
A hidden mechanism left in a system that lets someone bypass its normal protections.
As stated in the literature
A covert pathway intentionally embedded in software (or model weights) that allows an attacker or operator to bypass security or behavioral controls.
Why it matters: Backdoors are a serious supply-chain risk: a compromised dependency or fine-tuning dataset could plant one that's nearly impossible to detect from normal use.
For example, a maliciously trained model might respond normally except when it sees a particular trigger phrase, then leak data or change its behavior.
Heard on the show
“But there's a gap between "this signal exists" and "I can build a backdoor on it.”Episode 158 — How Floating-Point Rounding Lets a Model Tell Which Chip It's On — And Misbehave