Definition
Plain language
Training a model by showing it examples of correct answers and having it imitate them.
As stated in the literature
Supervised Fine-Tuning, a post-training stage in which a model is trained on labeled demonstrations via standard next-token prediction.
Also called: supervised fine-tuning
Why it matters: It's the simplest and cheapest way to inject new behavior into a base model, and it's almost always the first step of any post-training pipeline.
For example, to teach a model to refuse harmful requests politely, you fine-tune it on thousands of (harmful prompt, polite refusal) pairs.
Heard on the show
“First, supervised fine-tuning on all those traces — that installs the shape of good reasoning, the structure of the loop.”Episode 187 — An 8-Billion Agent That Beats Models 80 Times Its Size By Looking Things Up