Definition
Plain language
A famous Minecraft-playing AI that built up a library of reusable skills by learning from the game's feedback.
As stated in the literature
An LLM agent that accumulates a verifiable skill library in Minecraft, able to self-improve because the environment provides free correctness signals; contrasted with skill domains that lack any verifier.
Why it matters: It shows that an agent can keep self-improving when the environment hands it free signals about what works, and highlights how much harder this is where no such checker exists.
For example, it learns to chop wood and craft tools in Minecraft, saving each new ability into a growing library it reuses later.
Heard on the show
“… tap-to-define, with links to the related work grouped by theme, from the code-as-policy lineage to Voyager and the VLA baselines. …”Episode 194 — How a Robot Builds a Debugging Notebook It Can Read, Edit, and Hand to Another Robot