Glossary · Term

AutoRater

← all terms

Definition

An automated checker that grades whether an AI agent has hit each milestone in a task.

A separate LLM-based call within agent frameworks that reads the action history, compares it against a list of subgoals, and updates a binary progress vector consumed by the next decision step.

Mentioned in 1 episode

  1. 008
    Why Long-Horizon AI Agents Get Stuck, and a Milestone-Based Fix That Helps