Glossary · Term

arXiv

← all terms

Definition

Plain language

The website where researchers post their papers for free, often before any formal review.

As stated in the literature

An open-access preprint server (pronounced 'archive') hosting research papers in physics, math, and computer science; the primary venue where AI papers appear, frequently days before peer review.

Why it matters: It lets new findings spread fast and freely, which is why AI moves so quickly, but it also means work circulates before formal vetting.

For example, a research team can post their new method on arXiv on a Monday and have other labs reading and building on it by Tuesday.

Heard on the show

“Stage two: check each reference against six big bibliographic catalogs — Semantic Scholar, OpenAlex, CrossRef, DBLP, the ACL Anthology, and direct identifier lookups like DOIs and arXiv.”
Episode 201 — One in Four NeurIPS Papers Cites a Reference That Doesn't Exist

Mentioned in 154 episodes

  1. 201
    One in Four NeurIPS Papers Cites a Reference That Doesn't Exist
  2. 180
    The Bug Where Smart Assistants Read a Fact and Still Forget It
  3. 176
    An AI Designed Its Own Psychology Studies, Then Confirmed What It Found
  4. 161
    A Robot That Plays Before You Give It a Job, And Why That Beats Retrying
  5. 160
    Training an AI to Take Its Own Notes, So Its Future Self Works Better
  6. 159
    Can a Coding Agent Run Its Own Robot Experiments Overnight, With No Human Resetting the Scene?
  7. 158
    How Floating-Point Rounding Lets a Model Tell Which Chip It's On — And Misbehave
  8. 157
    When an AI Coding Agent Drives a Phone Through the Terminal, No Screen Needed
  9. 156
    Why More Human Demonstrations Made a Computer-Use Agent Worse
  10. 155
    Why a Flawless Demo Makes a Worse Computer-Using Agent, And the Fix
  11. 154
    How a 7B Model Out-Investigates a 72B One by Choosing What to Look At
  12. 153
    Catching a Lie From the Inside, When the Words Look Completely Honest
  13. 152
    Training a Model to Mean What It Says, And Why That Isn't the Same as Being Good
  14. 151
    Why More Experience Made This AI Agent Worse, And How to Fix It
  15. 150
    Don't Kill the Loser: A Different Way to Handle Two AI Agents Colliding
  16. 149
    When Cornering a Chatbot Makes It Lie: J.P. Morgan's Case for 'Playing Dead'
  17. 148
    Why Letting an AI Watch Its Own Scoreboard Can Quietly Overwrite Its Safety
  18. 147
    Agents Fail at the Body, Not the Brain: A Self-Rewriting Scaffold That Lifts a 9B Model 44 Points
  19. 146
    How an Innocent README Can Freeze an AI Agent's Safety Check for an Hour
  20. 145
    Building Forgetting Into a Language Model With One Extra Line of Code
  21. 144
    When an AI Agent Just Copies Its Tool — And Bigger Models Copy More
  22. 143
    When a Model Notices You Forged Its Own Words, And Why That Breaks Safety Tests
  23. 142
    Training a Tiny Model to Run the Plumbing Between an Agent and the World
  24. 141
    How Two Tokens Reopened a Reasoning Method the Field Had Given Up On
  25. 140
    When a Reasoning Model Says "Let Me Double-Check" After It's Already Decided
  26. 139
    When Optimizing One GPU Kernel Quietly Breaks the Whole System
  27. 133
    How MiniMax Turned a Reward-Hacking Disaster Into Olympiad Gold
  28. 132
    The Agent Failed — But Did the Instructions Deserve to Be Followed?
  29. 131
    Why Autonomous Research Agents Forget Their Own Lessons, and Arbor's Fix
  30. 130
    Why AI Agents Coordinate Better Through a Shared Board Than a Boss
  31. 129
    How a Crowd of Anonymous AI Agents Broke a 40-Year Math Record
  32. 128
    How a Model Can Earn Full Reward and Still Resist Training
  33. 127
    What Diffusion Language Models Were Missing: A Map, Not an Algorithm
  34. 126
    How Coding Agents Can Mine Their Own Failures Into a Self-Targeting Curriculum
  35. 125
    AI Coding Agents Run a Marathon, and Fewer Than One in Three Finish
  36. 124
    A Cheap Model With the Blueprints Beats Expensive Models Working Blind
  37. 123
    Five Identical Worlds, One Swapped Model: What Happens When AI Agents Run for Fifteen Days
  38. 122
    When Your Coding Agent Lies About the Fix: Verifying the Plan Before the Model Runs
  39. 121
    When the Agent Says It's Done But Nothing Happened: Debugging the Harness, Not the Model
  40. 120
    How an AI Agent Rewrites Its Own Tools, Without an Answer Key
  41. 119
    Beating Reinforcement Learning Without Ever Touching the Model's Weights
  42. 118
    Why the Best-Aligned AI Models Are the Easiest to Trick Into Producing Harm
  43. 117
    How an Open AI System Verified 672 Hard Math Proofs for Under $300
  44. 116
    Why Streaming Half a Reasoning Chain Beats Sending the Whole Thing
  45. 115
    Teaching a Phone Agent to Reason Silently, And Keeping It Honest
  46. 114
    Agents That Rewrite Their Own Weights Instead of Just Taking Notes
  47. 113
    What If a Prompt Injection Never Left? Attacks That Wait in Agent Memory
  48. 112
    When an AI Agent Cheats Without Being Told: Inside the Meta-Agent Challenge
  49. 111
    How a 4B Web Agent Beat Models 60x Its Size on 500 Demonstrations
  50. 110
    How an Agent Got 44 Points Better by Mining Its Own Scratch Paper
  51. 109
    An AI Got Caught Reading the Answer Key, And Why That Catch Matters
  52. 108
    The Reasoning Cliff: Why Thinking Longer Makes Models Worse at Exact Step-by-Step Tasks
  53. 107
    How a Market of Crippled AI Agents Outscored One Unrestricted Model
  54. 106
    Giving Agents a Notebook Instead of New Weights: How ExpGraph Lets Frozen Models Learn
  55. 105
    The Trojan Is Your Agent's Memory: Why Single-Step Defenses Miss Persistent Attacks
  56. 104
    How Making a Research Agent Smarter Quietly Makes It Leak Your Secrets
  57. 103
    AI Agents Tried to Invent a Post-Human Language, And Reinvented Cherokee
  58. 102
    How to Catch an AI Attack That No Single Conversation Reveals
  59. 101
    Treating Math Formalization Like a Codebase, and Where the Agents Cheat
  60. 100
    How a Prompt Wrapper Lets a Frontier Model Play Poker Like an Expert
  61. 099
    How an Open-Book Trick Teaches a Model to Catch Its Own Mistakes
  62. 098
    Finding Millions of Readable Concepts Inside a Real, Deployed AI Model
  63. 097
    Same Tokens, Same Cost, Wildly Different Results: What Actually Scales in AI Agents
  64. 096
    How Treating an AI Agent's Execution Like Git Recovers a Coordination Penalty
  65. 095
    Seven Wins to Zero: How Organizing AI Agents Like a Lab Changes the Search
  66. 094
    Chain-of-Thought Monitoring Fails Across Languages, and Worst Where It's Needed Most
  67. 093
    A Calibrated Knob for Weak-to-Strong AI Oversight, Tested on Real Code
  68. 092
    When Search Agents Don't Really Search: The Memory Shortcut Hiding in Browsing Benchmarks
  69. 091
    When Better Fine-Tuning Can't Help: A Geometric Impossibility in LLM Causal Reasoning
  70. 090
    How MiniMax-M2 Bets That Sparsity Plus Verifiable Rewards Can Match Frontier Agents
  71. 089
    When AI-Written Papers Read Well But the Evidence Underneath Is Broken
  72. 088
    Two Levers for Self-Improving AI: When Rewriting Code Isn't Enough
  73. 087
    When No Agent Reads the Whole Document: A Universal Cliff in Multi-Agent Review
  74. 086
    Why Frozen-Weight Agents Still Get Worse Over Time
  75. 085
    Why Long-Context Models Might Need Compute, Not Capacity, Before Eviction
  76. 084
    Terminal Agents Get Free Supervision From The Tokens We've Been Throwing Away
  77. 083
    Training the Translator: How a Small Communication Model Lets Agent Teams Outperform Themselves
  78. 082
    Training a Deep Research Agent on 8,000 Synthetic Tasks: The Rubric Tree Trick
  79. 081
    When Reasoning Models Decide Before They Think: Detecting and Fixing Premature Confidence
  80. 080
    How a Two-Agent Trick Unlocked Large-Scale Training for Computer-Use Agents
  81. 079
    An Old Idea From Cognitive Psychology Reshapes How We Reward Reasoning Models
  82. 078
    Training a Markdown File: When LLM Self-Improvement Borrows the Discipline of Neural Net Training
  83. 077
    Reading a Model's Confidence Curve to Decide When Chain-of-Thought Is Worth It
  84. 076
    Same Model, Organized Differently: How an Agent Architecture Beat Frontier Systems at Research Math
  85. 075
    Growing Code and Proof Together: Verified Systems in Ten Hours Instead of a Year
  86. 074
    How a Fifteen-Hundred-Dollar Training Run Matched Llama and Gemma on Reasoning
  87. 073
    When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
  88. 072
    A Robot Made Graphene Without Help, And Caught Itself Hallucinating
  89. 071
    When the Model Is Fine and the Plumbing Is Broken: Fixing Agents at the Interface
  90. 070
    When Models Know the Answer But Say the Wrong Thing Anyway
  91. 069
    When Smarter Models Forecast Worse: The Hidden Failure Mode in LLM Predictions
  92. 068
    The OS Trick That Makes Tree Search Practical for Coding Agents
  93. 067
    An AI Just Solved a 1996 Erdős Problem—and the Simplest Agent Won
  94. 066
    Why Giving an AI Agent More Tools Can Make It Worse at Using a Computer
  95. 065
    One Loop to Optimize Them All: A Universal API for LLM-Driven Discovery
  96. 064
    When Agent Memory Stops Being a Database and Starts Being a Skill
  97. 063
    Why Web Agents Are Slow: A Compiler-Style Fix for Computer-Use Latency
  98. 062
    Treating Hallucinations as Exploits: A Gate-Based Architecture for Agent Safety
  99. 061
    When Helpful Agents Go Sideways: A 404 Error, Campus Security, and Why Alignment Misses This
  100. 060
    When Splitting One Model Across Three Agents Doubles Its Accuracy
  101. 059
    Firefly's Inversion: Building Verified Tool-Call Training Data by Working Backward
  102. 058
    Why Upgrading Your AI Auditor to a Smarter Model Can Make Your System Less Safe
  103. 057
    How Uber Caught 206 Leaked Credentials With an LLM-Powered Security Stack
  104. 055
    Why LLM Judges Flip Their Verdicts When You Change the Question Format
  105. 054
    When Models Learn the Monitor Exists, the Reasoning Trace Stops Being a Window
  106. 053
    An AI Agent Swapped In Focal Loss And Beat A Human-Tuned Training Script
  107. 052
    An Old Reinforcement Learning Tradeoff Sneaks Back Into LLM Agents
  108. 051
    Why Parallel Sampling Plateaus, And What Evidence Graphs Do Instead
  109. 049
    An AI Agent Reached for Root in Twelve Minutes, Without Being Attacked
  110. 048
    How a 30B Open Model Reached Olympiad Gold With the Right Recipe
  111. 047
    When Agent Benchmarks Lie: The Harness Problem in Open-Source AI
  112. 046
    When the AI Optimizer Edits the Grade Book: Why Harnessing Evolution Needs a Wall
  113. 045
    When a Frontier Model Talks Its Own Twin Into Climate Denial
  114. 044
    How One Sentence and a Forged History Flip the Most Aligned Models
  115. 043
    When 'This Is False' Doesn't Stick: Why Models Learn the Lie Anyway
  116. 042
    An Agentic Scientific Computing System That Actually Remembers What It Learns
  117. 041
    When the Iteration Teaches the Model to Skip the Iteration
  118. 040
    Two Frozen Models Learn to Whisper: Coupling Through Hidden States
  119. 039
    When Smarter Agents Get Fooled by Three Extra Nodes in a Database
  120. 038
    How LLMs Get Persuaded: One Attention Head, A Tetrahedron, And A Single Dial
  121. 037
    Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
  122. 036
    Sparse Attention Was the Wrong Frame. Treat It as Geometry Instead.
  123. 035
    Why Frontier Agents Ask for Clarification at Exactly the Wrong Moment
  124. 034
    Catching Multi-Agent Deadlocks Before Deployment With a 40-Year-Old Tool
  125. 033
    Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval
  126. 032
    A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
  127. 031
    When Your AI Assistant Won't Let Go of Old Facts About You
  128. 030
    Why Your AI Agent Won't Stop Working — and Each Model Falls for a Different Trap
  129. 028
    Teaching a Model to Hire Copies of Itself: Recursive Agent Optimization
  130. 027
    When AI Agents Build the Serving Stack: A Bet on Bespoke Infrastructure
  131. 026
    What RL Actually Does to Language Models, at the Token Level
  132. 025
    The Missing Gradient Term That Predicts Sycophancy in RLHF
  133. 024
    An AI Agent That Found 28 Zero-Days in Windows — And What Made It Work
  134. 023
    Why a Small Agent Confidently Overwrites Memories It Doesn't Understand
  135. 022
    Training the Model Spec Directly: An Alignment Lever Aimed at the Say-Do Gap
  136. 021
    Ten Thousand Examples Beat the Full Industrial Pipeline for Search Agents
  137. 019
    When the Best Reward Model Trains the Worst Policy: Inside EvoLM
  138. 018
    Language Models Compute the Rational Move, Then Override It
  139. 017
    When the Agent Grades Its Own Homework: A Brutal New Benchmark for AI Workers
  140. 016
    Why Your Coding Agent Stalls While the GPU Runs Hot
  141. 015
    The Audit Number Isn't What You Think: Sycophancy and the Case Against Single-Prompt Bias Tests
  142. 014
    Why a Constrained Pipeline Beat a Full Coding Agent at Finding Bugs 30-to-1
  143. 013
    Why Search Keeps Rediscovering the Same Workflow, and What That Means
  144. 012
    Why AI Coding Agents Keep Trying to Debug Without a Debugger
  145. 011
    When RL Actually Teaches Agents Something New, And When It Doesn't
  146. 010
    When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL
  147. 009
    How Two Silent Library Bugs Quietly Invalidated a Wave of Reasoning Papers
  148. 008
    Why Long-Horizon AI Agents Get Stuck, and a Milestone-Based Fix That Helps
  149. 007
    Exploration Hacking: When Models Sabotage Their Own RL Training
  150. 005
    Why a Debugger Designed for Humans Is the Wrong Tool for an AI Agent
  151. 004
    The Sycophancy Circuit That Survives Alignment Training
  152. 003
    How to Pick the Best of Sixteen Coding Agent Rollouts
  153. 002
    An AI Ran a Real Optics Lab for 21 Hours and Found a Transformer-Shaped Pattern in Light
  154. 001
    When AI Models Quietly Protect Each Other From Shutdown

Related terms