Concept · 50 episode(s)

Silent Failure

Read the guide: what the papers say about Silent Failure →

← all concepts

Definition

Silent failures are wrong outputs delivered with no error message and no obvious signal that anything went wrong. They’re the worst kind of failure to debug because nothing in the logs even flags them — the system simply got it wrong, confidently.

Episodes covering this

  1. 285
    What a Perfect Score Hides: Auditing an AI Agent That Scored 100
    Kepler: Auditable World Models for ARC-AGI-3
    Wu · Independent Researcher·14 min·Oct 02, 2026
  2. 284
    Four AI Models Steered a Real Corolla, and Only One Finished
    DrivingBench: Can Vision-Language Models Drive a Toyota Corolla?
    Ramabadran, Mahns, Gessler·14 min·Oct 01, 2026
  3. 283
    Why AI Reports Bury Bad News, And the Five Words That Change It
    Language Models Are "Insecure" Reporters
    Huang, Fan, Humayun et al. · Massachusetts Institute of Technology·13 min·Sep 30, 2026
  4. 279
    Two Idle Agents, One Kill Switch, and a 38% Sabotage Rate
    Shutdown Sabotage Propensities in Multi-Agent Systems
    Knecht, Schaller, Summerfield et al. · AI Safety Research Group·12 min·Sep 26, 2026
  5. 278
    Every Agent Safety Study Reads a Log the Agent Could Edit
    LLM Agents Can Easily Tamper With Their Own Traces
    Qin, Schmotz, Prinzhorn et al. · ELLIS Institute Tübingen·17 min·Sep 25, 2026
  6. 273
    When 85% on SWE-bench Turns Into 58% Under Proof
    SWE-Proof: Can Language Models Resolve Real-World Issues with Machine-Checked Proofs?
    Ma, Mikek, Li et al. · UCBerkeley·15 min·Sep 21, 2026
  7. 271
    The Proof Counter Hit Zero While a Third of It Was Missing
    Long-horizon autoformalization of a core theorem underlying MIP* = RE
    Lu, Deng, Zhu et al. · Max-Planck-Institut für Quantenoptik·17 min·Sep 19, 2026
  8. 270
    The Agent Said It Read 240 Files. The Log Says One.
    Quantifying Overclaiming Propensity in Frontier LLM Agents
    Smyth, Mantilla-Ramos, Notsawo et al. · Tara Research·14 min·Sep 19, 2026
  9. 269
    How a Forged Transcript Got Model Weights Past a Safety Monitor
    Red-Teaming Auto Mode: Improving Blocking Classifiers Against Malign Coding Agents
    Remedios, Storf, Roger et al. · Anthropic Fellows Program·18 min·Sep 18, 2026
  10. 268
    A Rigged Benchmark Taught a Self-Improving Agent to Always Disable SSL
    Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks
    Roesner, Kohno · University of Washington·20 min·Sep 18, 2026
  11. 256
    The Agent That Never Said It Failed, and the Monitor That Noticed
    CURA: Certified Runtime Alarms for Computer-Use Agents
    Kumar, Tayebati, Naik et al. · University of Illinois Chicago·24 min·Aug 31, 2026
  12. 251
    When a Fake Dashboard Makes an AI Agent Just as Confident
    Calibrated Enough to Know, Not Calibrated to Act: Fabricated Evidence Makes LLM Agents Commit to the Unknowable
    Aggarwal · Independent Researcher·24 min·Aug 29, 2026
  13. 246
    160 Perfect Refusals, And The Refusals Were The Leak
    Inadvertent Context Leakage in Language Models
    Fairoze, Mangaokar, Chaudhuri et al. · University of California·20 min·Aug 21, 2026
  14. 240
    Frontier Models Designed Follow-Ups To Fraudulent Papers 93% Of The Time
    TRACES: A Benchmark for Epistemic Reliability in Scientific Reasoning by LLMs
    Rodionov, Assylbekov · Case Western Reserve University·24 min·Aug 13, 2026
  15. 238
    How a Cheap Model Reads the Flagship's Secret Reasoning Aloud
    Stealing Reasoning Traces from Proprietary LLM APIs
    Panfilov, Schmotz, Shumailov et al. · MATS Research·19 min·Aug 11, 2026
  16. 232
    Coding Models Can Find the Bad Line, They Just Won't Delete It
    To Add Is Machine, To Delete Is Human: Measuring and Mitigating Deletion Avoidance in LLM Code Editing
    Ebrahimi, Hasan, Bhatia et al. · School of Computing·18 min·Aug 03, 2026
  17. 228
    Same Chatbot, Two Doors: Why 'Grok's Opinion' Doesn't Exist
    Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science
    Scarsoa, Almeidaab, Pinaac · Applied Social Sciences Department | NOVA School of Science and Technology - Universidade NOVA de Lisboa·16 min·Jul 27, 2026
  18. 225
    How a Frozen Model Went From Zero to Sixty Percent by Borrowing Another's Thinking
    Reasoning Fine-Tuning Induces Persistent Latent Policy States
    Harrasse, Lan, Batra et al. · Martian·15 min·Jul 22, 2026
  19. 224
    The AI Agent That Found the Truth and Typed the Lie Anyway
    DRNOISE: Benchmarking Deep Research Agents in Misleading Evidence Environments
    Nie, Yang, Tang et al. · Hong Kong Baptist University·14 min·Jul 21, 2026
  20. 222
    The Bias Isn't in Your Prompt — It's Inside the Model
    Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values
    Betley, Treutlein, Dubiński et al. · TruthfulAI·16 min·Jul 19, 2026
  21. 221
    Two Hundred Clean Economics Answers, And a Model That Endorses Race Science
    Innocuous-Seeming Data, Latent Ideology: Ideological Generalisation in Finetuned LLMs
    Graham, Stevinson, Barsheshat · Independent·15 min·Jul 17, 2026
  22. 214
    The Medical AI Answer That's Accurate, Sourced, and Still Wrong
    Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation
    Caruzzo, Yoo, Kim · Lunit·13 min·Jul 13, 2026
  23. 208
    The Blank Space in Your AI Approval Box That Isn't Empty
    Unicode TAG-Block Concealment of Tool-Metadata Payloads in the Model Context Protocol: An Approval-View Fidelity Gap Across Three Independent Server Implementations
    Rashidi · Department of Computer Science·15 min·Jul 08, 2026
  24. 202
    How Do You Know an AI Agent Actually Refused? Check the World, Not the Words
    Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification
    Feng, Lin, Wen et al. · AntGroup / Hunan Institute of Advanced Technology·18 min·Jul 06, 2026
  25. 201
    One in Four NeurIPS Papers Cites a Reference That Doesn't Exist
    Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences
    Russinovich, Kumar, Salem · Microsoft·19 min·Jul 06, 2026
  26. 195
    Why 'Be Careful' Does Nothing for AI Coding Agents, and What Does
    Coding Agents Are Guessing: Measuring Action-Boundary Violations in Underspecified DevOps Instructions
    Ji, Zhang, Xu et al. · Hong Kong University of Science and Technology·15 min·Jul 03, 2026
  27. 184
    An AI Built an Undetectable Secret Channel, And Another AI Couldn't Find It
    Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systems
    Rippin, Marshall, Africa et al. · Oxford University·19 min·Jun 30, 2026
  28. 173
    The Free Step-Level Grader Hiding in Every RL Training Run
    Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents
    Oh, Li, Park et al. · University of Wisconsin–Madison·22 min·Jun 25, 2026
  29. 164
    The Summarizer That Quietly Deletes Your Agent's Safety Rules
    Governance Decay: How Context Compaction Silently Erases Safety Constraints in Long-Horizon LLM Agents
    Chen · Beijing Institute of Technology·28 min·Jun 23, 2026
  30. 155
    Why a Flawless Demo Makes a Worse Computer-Using Agent, And the Fix
    Skill-Guided Continuation Distillation for GUI Agents
    Fan, Yu, Shen et al. · StepFun·22 min·Jun 18, 2026
  31. 150
    Don't Kill the Loser: A Different Way to Handle Two AI Agents Colliding
    CoAgent: Concurrency Control for Multi-Agent Systems
    Lyu, Zhang, Wu et al. · Shanghai Jiao Tong University·32 min·Jun 16, 2026
  32. 149
    When Cornering a Chatbot Makes It Lie: J.P. Morgan's Case for 'Playing Dead'
    Is Your Agent Playing Dead? Deployed LLM Agents Exhibit Constraint-Evasive Fabrication and Thanatosis
    Rodríguez, Pozanco, Borrajo · J.P. Morgan AI Research·23 min·Jun 16, 2026
  33. 144
    When an AI Agent Just Copies Its Tool — And Bigger Models Copy More
    When the Tool Decides: LLM Agents Defer Blindly to Graph Neural Network Tools, and Stronger Backbones Defer More
    Wang, Vemuri · raptorX.ai·15 min·Jun 15, 2026
  34. 139
    When Optimizing One GPU Kernel Quietly Breaks the Whole System
    Arbor: Tree Search as a Cognition Layer for Autonomous Agents
    Prakriya, Hou, Gong et al. · AMD·30 min·Jun 12, 2026
  35. 132
    The Agent Failed — But Did the Instructions Deserve to Be Followed?
    SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement
    Gautam, Radhakrishna, Gulwani · Microsoft·30 min·Jun 11, 2026
  36. 130
    Why AI Agents Coordinate Better Through a Shared Board Than a Boss
    Decentralized Multi-Agent Systems with Shared Context
    Mao, Mirhoseini · Stanford University·34 min·Jun 11, 2026
  37. 122
    When Your Coding Agent Lies About the Fix: Verifying the Plan Before the Model Runs
    Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory
    Wang, Huang, Wang et al. · University of Illinois Urbana-Champaign·24 min·Jun 09, 2026
  38. 121
    When the Agent Says It's Done But Nothing Happened: Debugging the Harness, Not the Model
    From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws
    Chen, Wang, Liu et al. · Institute of Software·27 min·Jun 05, 2026
  39. 113
    What If a Prompt Injection Never Left? Attacks That Wait in Agent Memory
    What If Prompt Injection Never Left? Exploring Cross-Session Stored Prompt Injection in Agentic Systems
    Xie, Liu, Zhang et al. · Institute of Information Engineering·27 min·Jun 04, 2026
  40. 109
    An AI Got Caught Reading the Answer Key, And Why That Catch Matters
    EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learning
    Chen, Shi, Li et al. · Shenzhen Institutes of Advanced Technology·28 min·Jun 03, 2026
  41. 102
    How to Catch an AI Attack That No Single Conversation Reveals
    Stateful Online Monitoring Catches Distributed Agent Attacks
    Brown, Bhargav, Santhanam et al. · University of Pennsylvania·24 min·Jun 01, 2026
  42. 092
    When Search Agents Don't Really Search: The Memory Shortcut Hiding in Browsing Benchmarks
    LiveBrowseComp: Are Search Agents Searching, or Just Verifying What They Already Know?
    Fan, Wang, Chu et al. · Harbin Institute of Technology·27 min·May 28, 2026
  43. 089
    When AI-Written Papers Read Well But the Evidence Underneath Is Broken
    ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence
    Meng, Mishra, Chen et al. · Google Cloud AI Research·32 min·May 27, 2026
  44. 087
    When No Agent Reads the Whole Document: A Universal Cliff in Multi-Agent Review
    A Universal Cliff and a Design Fingerprint: Cross-Section Defect Detection Under LLM Orchestration
    Fukui · Research Institute of Criminal Psychiatry·26 min·May 27, 2026
  45. 086
    Why Frozen-Weight Agents Still Get Worse Over Time
    Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systems
    Zhu, Ro, Robertson et al. · The University of Texas at Austin·23 min·May 27, 2026
  46. 072
    A Robot Made Graphene Without Help, And Caught Itself Hallucinating
    Qumus: Realization of An Embodied AI Quantum Material Experimentalist
    Shi, Zheng, Juan et al. · Princeton University·29 min·May 23, 2026
  47. 061
    When Helpful Agents Go Sideways: A 404 Error, Campus Security, and Why Alignment Misses This
    Agent Meltdowns: The Road to Hell Is Paved with Helpful Agents
    Jha, Triedman, Bhattacharya et al. · Cornell University·27 min·May 20, 2026
  48. 034
    Catching Multi-Agent Deadlocks Before Deployment With a 40-Year-Old Tool
    TraceFix: Repairing Agent Coordination Protocols with TLA+ Counterexamples
    Xia, Li, Ehsan et al. · Rutgers University·30 min·May 11, 2026
  49. 023
    Why a Small Agent Confidently Overwrites Memories It Doesn't Understand
    What Happens Inside Agent Memory? Circuit Analysis from Emergence to Diagnosis
    Mao, Zhao, Penn et al. · City University of Hong Kong·23 min·May 07, 2026
  50. 009
    How Two Silent Library Bugs Quietly Invalidated a Wave of Reasoning Papers
    SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning
    Limozin, Durech, Hoefler et al. · ETH AI Center·23 min·May 02, 2026

Worth reading next

Papers we haven't done a deep dive on yet, but would recommend on this topic.