Definition
Plain language
A measure of whether a chatbot can find its way back to its original view after it has given in.
As stated in the literature
A metric on multi-turn transcripts capturing the rate at which a model returns to the correct judgment following a first capitulation; empirically uncorrelated with resistance across the 17 models tested.
Also called: recovery
Why it matters: Holding firm and bouncing back turn out to be separate skills, so a model that looks stubborn may still be the one that never finds its way back to the truth.
For example, if a model agrees it was mistaken under pressure but two messages later says "actually, on reflection, my original read was right," that counts as a recovery.
Heard on the show
“When a domain tool fails or a step doesn't go as planned, the rigid mediator has no recovery path.”Episode 034 — Catching Multi-Agent Deadlocks Before Deployment With a 40-Year-Old Tool