Glossary · Term

commitment rate

← all terms

Definition

Plain language

How often a system chooses to give an answer instead of declining.

As stated in the literature

Fraction of trials on which a model selects the answer-with-probability option rather than abstaining or calling a tool; used here as the primary behavioral dependent variable.

Also called: commitment rates

Why it matters: It turns an abstract question about a model's judgment into a countable behavior, letting you see whether a system actually holds back on unanswerable questions or just says it would.

For example, if a model gives an answer on 90 out of 100 questions and declines on the rest, its commitment rate is 90%.

Heard on the show

“And the commitment rates?”
Episode 251 — When a Fake Dashboard Makes an AI Agent Just as Confident