Glossary · Term

warm start

← all terms

Definition

Plain language

Giving a model just enough initial training to get off the ground before letting it learn the rest by trial and error.

As stated in the literature

A lightweight initialization stage (e.g., a small set of filtered successful demonstrations) that bootstraps basic competence so subsequent RL exploration isn't pure flailing; OpenWebRL deliberately keeps it minimal to preserve policy plasticity.

Also called: warm-start, warm-starting

Why it matters: It matters because a small head start gives a model enough basic competence to learn productively, while keeping it light preserves its room to improve.

For example, before letting a web agent learn by trial and error, you first show it a few hundred successful task recordings so it isn't clicking randomly from the start.

Heard on the show

“One practical note: training the multiplayer model from scratch on their budget collapsed; warm-starting from a single-player model rescued it.”
Episode 206 — How Four-Second Clips Become Hours of Playable AI Soccer

Mentioned in 5 episodes

  1. 206
    How Four-Second Clips Become Hours of Playable AI Soccer
  2. 183
    Why You Can't Fine-Tune Foresight Into an AI Agent
  3. 111
    How a 4B Web Agent Beat Models 60x Its Size on 500 Demonstrations
  4. 080
    How a Two-Agent Trick Unlocked Large-Scale Training for Computer-Use Agents
  5. 042
    An Agentic Scientific Computing System That Actually Remembers What It Learns

Related terms