ARC-AGI

Definition

A reasoning benchmark of small visual puzzles designed to be easy for humans and hard for AI.

The Abstraction and Reasoning Corpus, an evaluation suite of grid-based abstract reasoning tasks used to probe general intelligence in AI systems.

Also called: ARC-AGI-2, ARC, ARC-Challenge

Mentioned in 4 episodes

1. 065
   One Loop to Optimize Them All: A Universal API for LLM-Driven Discovery
2. 060
   When Splitting One Model Across Three Agents Doubles Its Accuracy
3. 046
   When the AI Optimizer Edits the Grade Book: Why Harnessing Evolution Needs a Wall
4. 025
   The Missing Gradient Term That Predicts Sycophancy in RLHF