Definition
Plain language
A high-level international competition for high school students, especially in math.
As stated in the literature
A category of subject-area competitions (IMO, USAMO, etc.) used as frontier reasoning benchmarks for LLMs; producing proofs, not just final answers, is the defining challenge.
Why it matters: Olympiad problems demand creative proofs rather than pattern-matched answers, making them a sharp test of genuine reasoning.
For example, an IMO problem might ask the student to prove a particular inequality holds for all positive reals.
Heard on the show
“For the proof grader, it's human Olympiad grades.”Episode 178 — How an AI Reviewer Learned to Stop Going Easy on AI Writing