Glossary · Term

chain rule

← all terms

Definition

A basic calculus rule for combining how one change leads to another through a chain of steps.

In information theory, Shannon's chain rule decomposes joint entropy into a sum of conditional and marginal entropies; in calculus, the standard rule for differentiating function compositions.

Also called: Shannon's chain rule

Mentioned in 1 episode

  1. 025
    The Missing Gradient Term That Predicts Sycophancy in RLHF