Concept · 39 episode(s)

Trajectory Analysis

← all concepts

Definition

Trajectory analysis studies the full sequence of an agent’s states, actions, and observations on a task, looking for patterns that explain success or failure. It’s how you actually figure out why your agent is bad at long-horizon problems.

Episodes covering this

  1. 196
    AI Agents Reached Opposite Conclusions From the Same Data — and Passed Review
    The Agentic Garden of Forking Paths
    Miao, Pritchard, Zou · Stanford University·18 min·Jul 03, 2026
  2. 194
    How a Robot Builds a Debugging Notebook It Can Read, Edit, and Hand to Another Robot
    ASPIRE: Agentic /Skills Discovery for Robotics
    Lu, Wu, Kou et al. · NVIDIA·24 min·Jul 02, 2026
  3. 192
    A 32B Open Model Matched Frontier Systems By Learning to Take Notes
    AutoMem: Automated Learning of Memory as a Cognitive Skill
    Wu, Zhu, Zhang et al. · Stanford University·22 min·Jul 02, 2026
  4. 189
    Why Phone Agents Ace the Test and Crash on Your Actual Phone
    Xiaomi-GUI-0 Technical Report
    Team, Qu, Luan · Xiaomi·24 min·Jul 02, 2026
  5. 186
    How a Frozen Model Went From 2% to 77% on Physics Puzzles — Without Retraining
    Hierarchical Experimentalist Agents
    Chandra, Vaidyanathan, Dhanuka et al. · University of Massachusetts Amherst·22 min·Jun 30, 2026
  6. 181
    How to Backpropagate Blame Through a Team of Chatbots — And When It Backfires
    GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems
    Yang, Alrabah, Hakkani-Tür et al. · University of Illinois Urbana-Champaign·20 min·Jun 29, 2026
  7. 172
    One Bad Token Can Sink a Model's Math, And You Can Delete It
    Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning
    Ko, Kang, Lee · Seoul National University·22 min·Jun 25, 2026
  8. 171
    The Safety Decision a Model Makes Before It Thinks a Word
    Do Thinking Tokens Help with Safety?
    Ri, Panigrahi, Arora · Princeton Language and Intelligence·25 min·Jun 25, 2026
  9. 165
    A Free-Lunch Tweak That Lets a Tiny Agent Beat Frontier Giants
    Group-Graph Policy Optimization for Long-Horizon Agentic Reinforcement Learning
    Wang, Song, Zhang et al. · Peking University·22 min·Jun 23, 2026
  10. 159
    Can a Coding Agent Run Its Own Robot Experiments Overnight, With No Human Resetting the Scene?
    ENPIRE: Agentic Robot Policy Self-Improvement in the Real World
    Xiao, Xie, Zhang et al. · NVIDIA·23 min·Jun 19, 2026
  11. 150
    Don't Kill the Loser: A Different Way to Handle Two AI Agents Colliding
    CoAgent: Concurrency Control for Multi-Agent Systems
    Lyu, Zhang, Wu et al. · Shanghai Jiao Tong University·32 min·Jun 16, 2026
  12. 147
    Agents Fail at the Body, Not the Brain: A Self-Rewriting Scaffold That Lifts a 9B Model 44 Points
    HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
    Chen, Lu, Zhao et al. · ·30 min·Jun 15, 2026
  13. 130
    Why AI Agents Coordinate Better Through a Shared Board Than a Boss
    Decentralized Multi-Agent Systems with Shared Context
    Mao, Mirhoseini · Stanford University·34 min·Jun 11, 2026
  14. 126
    How Coding Agents Can Mine Their Own Failures Into a Self-Targeting Curriculum
    Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills
    Xiao, Jiao, Wang et al. · Shanghai Jiao Tong University·21 min·Jun 09, 2026
  15. 125
    AI Coding Agents Run a Marathon, and Fewer Than One in Three Finish
    SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?
    Desai, Hu, Cabezas et al. · Abundant·27 min·Jun 09, 2026
  16. 122
    When Your Coding Agent Lies About the Fix: Verifying the Plan Before the Model Runs
    Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory
    Wang, Huang, Wang et al. · University of Illinois Urbana-Champaign·24 min·Jun 09, 2026
  17. 121
    When the Agent Says It's Done But Nothing Happened: Debugging the Harness, Not the Model
    From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws
    Chen, Wang, Liu et al. · Institute of Software·27 min·Jun 05, 2026
  18. 120
    How an AI Agent Rewrites Its Own Tools, Without an Answer Key
    Retrospective Harness Optimization: Improving LLM Agents via Self-Preference over Trajectory Rollouts
    Pan, Liu, Lin et al. · City University of Hong Kong·30 min·Jun 05, 2026
  19. 110
    How an Agent Got 44 Points Better by Mining Its Own Scratch Paper
    Inducing Reasoning Primitives from Agent Traces
    Lei, Yan, Momo et al. · Carnegie Mellon University·27 min·Jun 03, 2026
  20. 109
    An AI Got Caught Reading the Answer Key, And Why That Catch Matters
    EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learning
    Chen, Shi, Li et al. · Shenzhen Institutes of Advanced Technology·28 min·Jun 03, 2026
  21. 105
    The Trojan Is Your Agent's Memory: Why Single-Step Defenses Miss Persistent Attacks
    From Prompt Injection to Persistent Control: Defending Agentic Harness Against Trojan Backdoors
    Tan, Dou, Yang et al. · Gaoling School of Artificial Intelligence·26 min·Jun 01, 2026
  22. 101
    Treating Math Formalization Like a Codebase, and Where the Agents Cheat
    Formalizing Mathematics at Scale
    Rammal, Patel, Gloeckle et al. · FAIR at Meta / CERMICS·27 min·May 29, 2026
  23. 096
    How Treating an AI Agent's Execution Like Git Recovers a Coordination Penalty
    Shepherd: A Runtime Substrate Empowering Meta-Agents with a Formalized Execution Trace
    Yu, Chong, Nandi et al. · Northeastern University·22 min·May 28, 2026
  24. 092
    When Search Agents Don't Really Search: The Memory Shortcut Hiding in Browsing Benchmarks
    LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?
    Fan, Wang, Chu et al. · Harbin Institute of Technology·27 min·May 28, 2026
  25. 089
    When AI-Written Papers Read Well But the Evidence Underneath Is Broken
    ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence
    Meng, Mishra, Chen et al. · Google Cloud AI Research·32 min·May 27, 2026
  26. 088
    Two Levers for Self-Improving AI: When Rewriting Code Isn't Enough
    SIA: Self Improving AI with Harness & Weight Updates
    Hebbar, Manawat, Verboomen et al. · Hexo Labs·25 min·May 27, 2026
  27. 084
    Terminal Agents Get Free Supervision From The Tokens We've Been Throwing Away
    ECHO: Terminal Agents Learn World Models for Free
    Shrivastava, Kauffmann, Awadallah et al. · Microsoft Research·26 min·May 26, 2026
  28. 081
    When Reasoning Models Decide Before They Think: Detecting and Fixing Premature Confidence
    Understanding and Mitigating Premature Confidence for Better LLM Reasoning
    Gai, Zeng, Baek et al. · Carnegie Mellon University·25 min·May 26, 2026
  29. 080
    How a Two-Agent Trick Unlocked Large-Scale Training for Computer-Use Agents
    CUA-Gym: Scaling Verifiable Training Environments and Tasks for Computer-Use Agents
    Wang, Lu, Wang et al. · The University of Hong Kong·32 min·May 26, 2026
  30. 071
    When the Model Is Fine and the Plumbing Is Broken: Fixing Agents at the Interface
    Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
    Xu, Wen, Li · Peking University·23 min·May 22, 2026
  31. 062
    Treating Hallucinations as Exploits: A Gate-Based Architecture for Agent Safety
    Hallucination as Exploit: Evidence-Carrying Multimodal Agents
    Zhang, Zheng, Yang · Shenzhen University·24 min·May 20, 2026
  32. 061
    When Helpful Agents Go Sideways: A 404 Error, Campus Security, and Why Alignment Misses This
    Agent Meltdowns: The Road to Hell Is Paved with Helpful Agents
    Jha, Triedman, Bhattacharya et al. · Cornell University·27 min·May 20, 2026
  33. 059
    Firefly's Inversion: Building Verified Tool-Call Training Data by Working Backward
    Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs
    Lu, Wang, Lu et al. · Northeastern University·22 min·May 20, 2026
  34. 057
    How Uber Caught 206 Leaked Credentials With an LLM-Powered Security Stack
    ADR: An Agentic Detection System for Enterprise Agentic AI Security
    Li, Hu, Xu et al. · Uber Technologies·28 min·May 19, 2026
  35. 052
    An Old Reinforcement Learning Tradeoff Sneaks Back Into LLM Agents
    Look Before You Leap: Autonomous Exploration for LLM Agents
    Ye, Shi, Liu et al. · University of Science and Technology of China / Meituan·23 min·May 18, 2026
  36. 044
    How One Sentence and a Forged History Flip the Most Aligned Models
    History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions
    Salgado · Independent Researcher·23 min·May 15, 2026
  37. 035
    Why Frontier Agents Ask for Clarification at Exactly the Wrong Moment
    Ask Early, Ask Late, Ask Right: When Does Clarification Timing Matter for Long-Horizon Agents?
    Gulati, Gupta, Lumer et al. · PricewaterhouseCoopers U.S.·29 min·May 11, 2026
  38. 034
    Catching Multi-Agent Deadlocks Before Deployment With a 40-Year-Old Tool
    TraceFix: Repairing Agent Coordination Protocols with TLA+ Counterexamples
    Xia, Li, Ehsan et al. · Rutgers University·30 min·May 11, 2026
  39. 008
    Why Long-Horizon AI Agents Get Stuck, and a Milestone-Based Fix That Helps
    A Subgoal-driven Framework for Improving Long-Horizon LLM Agents
    Wang, Gooding, Hartmann et al. · Google DeepMind·24 min·May 02, 2026

Worth reading next

Papers we haven't done a deep dive on yet, but would recommend on this topic.