Glossary · Term

Cauchy-Schwarz

← all terms

Definition

Plain language

A basic math inequality that puts a ceiling on how big a certain combination of two things can get.

As stated in the literature

The Cauchy-Schwarz inequality bounding inner products by the product of norms; used in this corpus to prove that low reward variance caps the magnitude of policy gradients.

Why it matters: It's a foundational inequality that recurs across math and ML proofs, including in arguments about when RL training has enough signal to learn anything.

For example, applying Cauchy-Schwarz, you can show that if a model's reward signal has almost no variance across samples, the resulting policy gradient must be small.

Heard on the show

“The paper does it with a Cauchy-Schwarz argument, but the picture is just: similar inputs, bounded weights, bounded output gap.”
Episode 091 — When Better Fine-Tuning Can't Help: A Geometric Impossibility in LLM Causal Reasoning

Mentioned in 3 episodes

  1. 091
    When Better Fine-Tuning Can't Help: A Geometric Impossibility in LLM Causal Reasoning
  2. 076
    Same Model, Organized Differently: How an Agent Architecture Beat Frontier Systems at Research Math
  3. 010
    When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL

Related terms