Glossary · Term

amortized inference

← all terms

Definition

Paying expensive setup work once so every later query becomes cheap.

The pattern of training a system to produce good answers in a single forward pass, replacing per-instance optimization with up-front training cost amortized across many queries.

Also called: amortization

Mentioned in 2 episodes

  1. 063
    Why Web Agents Are Slow: A Compiler-Style Fix for Computer-Use Latency
  2. 013
    Why Search Keeps Rediscovering the Same Workflow, and What That Means