Glossary · Term

circuit

← all terms

Definition

Plain language

A small group of parts inside an AI model that work together to carry out one specific job, like a little wiring diagram.

As stated in the literature

In mechanistic interpretability, a subgraph of model components — particular attention heads, MLP units, and the connections between them — that jointly implements an identifiable behavior; the level at which OV and QK circuits are analyzed.

Also called: circuits

Why it matters: Identifying circuits lets researchers explain why a model does what it does, turning an opaque network into something that can be inspected and debugged.

For example, researchers might find that a handful of attention heads working together are responsible for copying a name mentioned earlier in a sentence.

Heard on the show

“A lot of mechanistic interpretability proceeds by looking for localized causes — the salient token, the sparse feature, the identifiable circuit — because that's what makes attribution tractable.”
Episode 243 — How a Hundred Meaningless Word Choices Add Up to Flip a Model's Answer

Mentioned in 12 episodes

  1. 243
    How a Hundred Meaningless Word Choices Add Up to Flip a Model's Answer
  2. 188
    A Coding Agent Found a Hole in a Peer-Reviewed STOC Proof for Five Dollars
  3. 146
    How an Innocent README Can Freeze an AI Agent's Safety Check for an Hour
  4. 073
    When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
  5. 055
    Why LLM Judges Flip Their Verdicts When You Change the Question Format
  6. 038
    How LLMs Get Persuaded: One Attention Head, A Tetrahedron, And A Single Dial
  7. 037
    Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
  8. 023
    Why a Small Agent Confidently Overwrites Memories It Doesn't Understand
  9. 018
    Language Models Compute the Rational Move, Then Override It
  10. 010
    When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL
  11. 006
    What Happens Inside Claude When It Decides to Blackmail Someone
  12. 004
    The Sycophancy Circuit That Survives Alignment Training

Related terms