Glossary · Term

commitment

← all terms

Definition

Plain language

How much of an AI's work has been locked into a particular interpretation, so that a later correction can only fix what hasn't yet been built.

As stated in the literature

In long-horizon agent analysis, the fraction of an agent's actions that are causally locked into a specific interpretation of underspecified inputs at a given trajectory position, bounding the value of subsequent clarification.

Why it matters: It quantifies why late clarifications are nearly worthless in long agent runs and argues for asking the right questions early.

For example, by the time a coding agent has written 500 lines assuming the user wanted a CLI tool, asking 'did you mean a web app?' can only fix the parts not yet built.

Heard on the show

“The moment you're grading an essay or an open argument, there's no exact match to commit to, and the author flags open-ended commitment as unsolved.”
Episode 207 — An AI Graded Its Own Math Test 94 Percent — It Actually Scored 20

Mentioned in 20 episodes

  1. 207
    An AI Graded Its Own Math Test 94 Percent — It Actually Scored 20
  2. 203
    The Thought a Model Doesn't Say — and the Lens That Reads It
  3. 171
    The Safety Decision a Model Makes Before It Thinks a Word
  4. 169
    Why Better Bug Reports Can Make AI Coding Agents Worse
  5. 152
    Training a Model to Mean What It Says, And Why That Isn't the Same as Being Good
  6. 141
    How Two Tokens Reopened a Reasoning Method the Field Had Given Up On
  7. 140
    When a Reasoning Model Says "Let Me Double-Check" After It's Already Decided
  8. 094
    Chain-of-Thought Monitoring Fails Across Languages, and Worst Where It's Needed Most
  9. 086
    Why Frozen-Weight Agents Still Get Worse Over Time
  10. 081
    When Reasoning Models Decide Before They Think: Detecting and Fixing Premature Confidence
  11. 075
    Growing Code and Proof Together: Verified Systems in Ten Hours Instead of a Year
  12. 070
    When Models Know the Answer But Say the Wrong Thing Anyway
  13. 069
    When Smarter Models Forecast Worse: The Hidden Failure Mode in LLM Predictions
  14. 045
    When a Frontier Model Talks Its Own Twin Into Climate Denial
  15. 037
    Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
  16. 035
    Why Frontier Agents Ask for Clarification at Exactly the Wrong Moment
  17. 034
    Catching Multi-Agent Deadlocks Before Deployment With a 40-Year-Old Tool
  18. 032
    A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
  19. 026
    What RL Actually Does to Language Models, at the Token Level
  20. 020
    The Compliance Gap: Why AI Says Yes and Does No

Related terms

agent trajectory