Glossary · Term

reverse-perplexity curriculum

← all terms

Definition

A training trick where you show the model the most surprising examples first, then ease into familiar ones.

A supervised fine-tuning ordering that sorts training examples by descending perplexity under the starting model, exposing the most stylistically foreign examples first.

Also called: reverse perplexity curriculum

Mentioned in 1 episode

  1. 048
    How a 30B Open Model Reached Olympiad Gold With the Right Recipe