Glossary · Term

Bitter Lesson

← all terms

Definition

Rich Sutton's essay arguing that general learning methods that scale with compute always beat hand-crafted human cleverness.

Sutton's 2019 essay observing that across AI history, learning-based methods leveraging compute have repeatedly outperformed approaches relying on human-engineered priors and domain knowledge.

Mentioned in 1 episode

  1. 060
    When Splitting One Model Across Three Agents Doubles Its Accuracy