Definition
Plain language
A setting you choose before training a model, like how fast it should learn, as opposed to something the model figures out on its own.
As stated in the literature
A configuration value set prior to training (learning rate, batch size, schedule, regularization strength) rather than learned; suboptimal choices can confound baseline comparisons independent of architecture or data.
Also called: hyperparameters
Why it matters: A poorly chosen setting can make a model look worse than a rival regardless of its design, so unfair comparisons often trace back to these choices.
For example, you decide how fast the model should learn before training even begins, rather than letting it discover that pace on its own.
Heard on the show
“But now you've got fragile hyperparameters and scales you can't calibrate.”Episode 189 — Why Phone Agents Ace the Test and Crash on Your Actual Phone