Definition
Plain language
A famous Minecraft-playing AI that built up a library of reusable skills by learning from the game's feedback.
As stated in the literature
An LLM agent that accumulates a verifiable skill library in Minecraft, able to self-improve because the environment provides free correctness signals; contrasted with skill domains that lack any verifier.
Why it matters: It shows that an agent can keep self-improving when the environment hands it free signals about what works, and highlights how much harder this is where no such checker exists.
For example, it learns to chop wood and craft tools in Minecraft, saving each new ability into a growing library it reuses later.
Heard on the show
“Compare it to the famous skill-library work before this — Voyager, the Minecraft agent that built up a library of reusable abilities.”Episode 132 — The Agent Failed — But Did the Instructions Deserve to Be Followed?