Definition
Plain language
A small simulated crafting environment in the style of Minecraft, used to test agents on hierarchical tasks.
As stated in the literature
A text-based agent benchmark involving recipe-driven crafting tasks, used as both an evaluation and a tunable testbed for hierarchical agent training.
Also called: TextCraft-Synth
Why it matters: It is a cheap, controllable testbed for hierarchical planning that doesn't require running a heavy game engine.
For example, an agent in TextCraft might need to gather wood, craft a pickaxe, mine stone, and then craft a furnace to complete a recipe.
Heard on the show
“The first benchmark is something the authors built themselves — a synthetic Minecraft-style crafting task they call TextCraft-Synth.”Episode 028 — Teaching a Model to Hire Copies of Itself: Recursive Agent Optimization