counterfactual

Definition

Plain language

Asking what would have happened if you had done something differently.

Also called: counterfactuals, counterfactual reasoning

Why it matters: Counterfactual reasoning is what separates real causal understanding from pattern-matching on correlations.

For example, asking 'would the patient have survived if they had received the drug?' is a counterfactual question, distinct from observing survival rates among those who actually got it.

Heard on the show

“The other is a counterfactual — swap one feature of the setup and measure how much that one feature was contributing.”

Mentioned in 12 episodes

1. 174
   When the AI 'Schemes,' It's Usually Just Lazy or Confused
2. 164
   The Summarizer That Quietly Deletes Your Agent's Safety Rules
3. 152
   Training a Model to Mean What It Says, And Why That Isn't the Same as Being Good
4. 109
   An AI Got Caught Reading the Answer Key, And Why That Catch Matters
5. 105
   The Trojan Is Your Agent's Memory: Why Single-Step Defenses Miss Persistent Attacks
6. 090
   How MiniMax-M2 Bets That Sparsity Plus Verifiable Rewards Can Match Frontier Agents
7. 086
   Why Frozen-Weight Agents Still Get Worse Over Time
8. 084
   Terminal Agents Get Free Supervision From The Tokens We've Been Throwing Away
9. 064
   When Agent Memory Stops Being a Database and Starts Being a Skill
10. 051
    Why Parallel Sampling Plateaus, And What Evidence Graphs Do Instead
11. 042
    An Agentic Scientific Computing System That Actually Remembers What It Learns
12. 026
    What RL Actually Does to Language Models, at the Token Level

Related terms