rollout

Definition

One complete run of an agent or model attempting a task from start to finish.

A single sampled trajectory of an agent's actions and observations from initial state to terminal state, used in RL training and evaluation.

Also called: rollouts

Mentioned in 17 episodes

1. 079
   An Old Idea From Cognitive Psychology Reshapes How We Reward Reasoning Models
2. 069
   When Smarter Models Forecast Worse: The Hidden Failure Mode in LLM Predictions
3. 068
   The OS Trick That Makes Tree Search Practical for Coding Agents
4. 065
   One Loop to Optimize Them All: A Universal API for LLM-Driven Discovery
5. 064
   When Agent Memory Stops Being a Database and Starts Being a Skill
6. 061
   When Helpful Agents Go Sideways: A 404 Error, Campus Security, and Why Alignment Misses This
7. 052
   An Old Reinforcement Learning Tradeoff Sneaks Back Into LLM Agents
8. 048
   How a 30B Open Model Reached Olympiad Gold With the Right Recipe
9. 047
   When Agent Benchmarks Lie: The Harness Problem in Open-Source AI
10. 044
    How One Sentence and a Forged History Flip the Most Aligned Models
11. 028
    Teaching a Model to Hire Copies of Itself: Recursive Agent Optimization
12. 026
    What RL Actually Does to Language Models, at the Token Level
13. 011
    When RL Actually Teaches Agents Something New, And When It Doesn't
14. 010
    When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL
15. 007
    Exploration Hacking: When Models Sabotage Their Own RL Training
16. 003
    How to Pick the Best of Sixteen Coding Agent Rollouts
17. 001
    When AI Models Quietly Protect Each Other From Shutdown

Related concepts