Definition
Plain language
A benchmark of real web tasks used to evaluate browsing agents.
As stated in the literature
A web-agent evaluation suite covering hundreds of tasks across real-world websites, used as a standard reference for browsing-agent generalization.
Why it matters: It provides a common yardstick for whether web agents actually generalize to the messy, varied websites people use.
For example, a browsing agent might be asked to find a one-way flight from Boston to Tokyo on a real airline site as one of the benchmark tasks.
Heard on the show
“Mind2Web 2, an earlier paper from the same Ohio State group, was the hand-crafted version.”Episode 082 — Training a Deep Research Agent on 8,000 Synthetic Tasks: The Rubric Tree Trick