Glossary · Term

CPU

← all terms

Definition

Plain language

The main chip in your computer that does most of the general-purpose work.

As stated in the literature

Central Processing Unit — the general-purpose processor handling most program logic, distinct from a GPU which specializes in parallel workloads.

Why it matters: Knowing what runs on CPU versus GPU governs nearly every performance and cost decision in modern ML systems.

For example, the CPU handles your operating system, browser logic, and most everyday apps, while the GPU sits idle until you launch a game or AI workload.

Heard on the show

“Because it all runs as bookkeeping on the CPU and never touches the GPU.”
Episode 165 — A Free-Lunch Tweak That Lets a Tiny Agent Beat Frontier Giants

Mentioned in 9 episodes

  1. 165
    A Free-Lunch Tweak That Lets a Tiny Agent Beat Frontier Giants
  2. 158
    How Floating-Point Rounding Lets a Model Tell Which Chip It's On — And Misbehave
  3. 116
    Why Streaming Half a Reasoning Chain Beats Sending the Whole Thing
  4. 100
    How a Prompt Wrapper Lets a Frontier Model Play Poker Like an Expert
  5. 063
    Why Web Agents Are Slow: A Compiler-Style Fix for Computer-Use Latency
  6. 036
    Sparse Attention Was the Wrong Frame. Treat It as Geometry Instead.
  7. 016
    Why Your Coding Agent Stalls While the GPU Runs Hot
  8. 009
    How Two Silent Library Bugs Quietly Invalidated a Wave of Reasoning Papers
  9. 006
    What Happens Inside Claude When It Decides to Blackmail Someone

Related concepts