Glossary · Term

Gaussian

← all terms

Definition

Plain language

The bell curve — the symmetric, hump-shaped spread of values that shows up constantly in nature and statistics.

As stated in the literature

The normal distribution, parameterized by a mean and variance; ubiquitous as a noise model, a prior, and in the analysis of wide networks and Gaussian processes. A Gaussian peak appears as the true-utility target in the FPO toy experiment.

Also called: Gaussian distribution, Gaussian peak

Why it matters: It is the default way to model random noise and uncertainty, so it shows up almost everywhere data and learning are analyzed.

For example, if you measure the heights of thousands of people, most cluster near the average and fewer fall at the very tall or very short ends, forming the familiar bell shape.

Heard on the show

“… between point-three and point-six times the original resolution, and about half the time add a little Gaussian noise — roughly a ten percent pixel jitter, so visible grain, not destruction. …”
Episode 242 — Making a Vision Model Better by Showing It Blurry Images

Mentioned in 3 episodes

  1. 242
    Making a Vision Model Better by Showing It Blurry Images
  2. 188
    A Coding Agent Found a Hole in a Peer-Reviewed STOC Proof for Five Dollars
  3. 025
    The Missing Gradient Term That Predicts Sycophancy in RLHF

Related terms