Definition
Plain language
A basic math inequality that puts a ceiling on how big a certain combination of two things can get.
As stated in the literature
The Cauchy-Schwarz inequality bounding inner products by the product of norms; used in this corpus to prove that low reward variance caps the magnitude of policy gradients.
Why it matters: It's a foundational inequality that recurs across math and ML proofs, including in arguments about when RL training has enough signal to learn anything.
For example, applying Cauchy-Schwarz, you can show that if a model's reward signal has almost no variance across samples, the resulting policy gradient must be small.
Heard on the show
“The paper does it with a Cauchy-Schwarz argument, but the picture is just: similar inputs, bounded weights, bounded output gap.”Episode 091 — When Better Fine-Tuning Can't Help: A Geometric Impossibility in LLM Causal Reasoning