Glossary · Term

MRT

← all terms

Definition

Plain language

A training method that watches how confident a model is partway through its reasoning to make it reason more efficiently.

As stated in the literature

A concurrent method that uses a model's intermediate-step confidence as a reinforcement-learning signal, aimed at improving test-time efficiency rather than reasoning quality; cited as adjacent work to progressive-confidence-shaping.

Why it matters: It aims to cut wasted computation by training models to stop reasoning when they're already confident, saving time and cost.

For example, if a model is already highly confident partway through solving a problem, this method can use that signal to encourage it to wrap up sooner rather than keep reasoning.

Heard on the show

“… early-answering interventions that's conceptually adjacent — Lanham and others — and a concurrent paper called MRT that also uses intermediate confidence as an RL signal, but for a different goal, test-time efficiency …”
Episode 081 — When Reasoning Models Decide Before They Think: Detecting and Fixing Premature Confidence

Mentioned in 1 episode

  1. 081
    When Reasoning Models Decide Before They Think: Detecting and Fixing Premature Confidence