Glossary · Term

auxiliary loss

← all terms

Definition

An extra training signal added alongside the main objective to teach a model a side skill.

A secondary training objective combined with the primary loss to inject additional supervision; in ECHO, next-token cross-entropy on environment-produced tokens layered onto GRPO with a small weight coefficient.

Also called: auxiliary objective

Mentioned in 1 episode

  1. 084
    Terminal Agents Get Free Supervision From The Tokens We've Been Throwing Away