mutual information

Definition

A measure of how much knowing one thing tells you about another.

An information-theoretic quantity measuring the reduction in entropy of one random variable given knowledge of another; zero indicates statistical independence.

Mentioned in 2 episodes

1. 020
   The Compliance Gap: Why AI Says Yes and Does No
2. 010
   When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL