Definition
Plain language
Rich Sutton, the RL researcher whose essay 'The Bitter Lesson' argued that scalable learning beats hand-crafted methods.
As stated in the literature
Richard Sutton, RL pioneer whose 2019 'Bitter Lesson' essay observes that across AI history, learning-based methods leveraging compute have repeatedly outperformed approaches relying on human-engineered priors.
Why it matters: His framing shapes how the field weighs hand-crafted structure against raw scale, and is invoked in nearly every debate about where AI progress comes from.
For example, Sutton's 'Bitter Lesson' argues that decades of chess and Go research lost out to general learning methods that just scaled with compute.
Heard on the show
“There's this idea from Silver and Sutton last year — the "era of experience" — agents that learn from their own experience at test time rather than only from a frozen training set.”Episode 160 — Training an AI to Take Its Own Notes, So Its Future Self Works Better