Glossary · Term

Live-SWE-agent

← all terms

Definition

Plain language

A strong agentic coding system used as a comparison baseline on SWE-bench Verified.

As stated in the literature

A high-scoring agentic software-engineering system used as a state-of-the-art comparison point against DAIRA-based agents on SWE-bench Verified, typically run on Claude-family backbones.

Why it matters: Having a strong public baseline keeps claims of progress honest in a field where small benchmark deltas are easy to overstate.

For example, when reporting SWE-bench Verified scores, a new agent paper might list its result next to Live-SWE-agent's to show how close it gets to the current state of the art.

Heard on the show

“The strongest baseline they report — an agent called Live-SWE-agent at seventy-nine-point-two percent — uses Claude 4.”
Episode 012 — Why AI Coding Agents Keep Trying to Debug Without a Debugger

Mentioned in 1 episode

  1. 012
    Why AI Coding Agents Keep Trying to Debug Without a Debugger

Related terms