Definition
Plain language
The bell curve — the symmetric, hump-shaped spread of values that shows up constantly in nature and statistics.
As stated in the literature
The normal distribution, parameterized by a mean and variance; ubiquitous as a noise model, a prior, and in the analysis of wide networks and Gaussian processes. A Gaussian peak appears as the true-utility target in the FPO toy experiment.
Also called: Gaussian distribution, Gaussian peak
Why it matters: It is the default way to model random noise and uncertainty, so it shows up almost everywhere data and learning are analyzed.
For example, if you measure the heights of thousands of people, most cluster near the average and fewer fall at the very tall or very short ends, forming the familiar bell shape.
Heard on the show
“They build a 50-dimensional setup where the true human utility is a Gaussian peak — a bump in the middle of the space — and the reward model is *linear*.”Episode 025 — The Missing Gradient Term That Predicts Sycophancy in RLHF