Definition
Plain language
How often an attack actually worked, out of all the times it was tried.
As stated in the literature
The fraction of adversarial trials in which the target system produced the attacker's intended behavior; typically reported per attack category, model, and condition.
Also called: attack rates
Why it matters: It turns vague claims like "this model can be tricked" into a number you can compare across models, defenses, and conditions, which is what makes safety testing more than anecdote.
For example, if a researcher tries the same jailbreak prompt 200 times and the model complies 34 times, the attack rate is 17 percent.
Heard on the show
“The lasting idea here isn't a ninety-four percent attack rate on any particular system — that number is joint, and it'll shift.”Episode 202 — How Do You Know an AI Agent Actually Refused? Check the World, Not the Words