Definition
Plain language
Training an AI by having copies of it challenge each other, instead of learning from human examples.
As stated in the literature
A training paradigm where a model improves by generating its own challenges and solutions — e.g., one instance proposing tasks and another solving them; effective but prone to curriculum drift and regression without targeting toward the real objective.
Why it matters: It lets a model keep improving from its own activity rather than scarce human data, though it can drift off course unless steered toward the real goal.
For example, one copy of a model invents practice problems while another copy tries to solve them, and both get better from the back-and-forth without any human-written examples.
Heard on the show
“If you want to train AI agents that cooperate and compete — self-play, team tactics, and everything in between — you need simulators cheaper than reality and safe to fail in.”Episode 206 — How Four-Second Clips Become Hours of Playable AI Soccer