Topic · 6 episodes across 3 reviews

What Our Measurements Miss: Hype, Culture, and Concepts

← all reviews

Two papers argued our yardsticks are compromised — user ratings track marketing more than capability, and text-only concepts erase the cultural variation that drawings preserve.

Covered in these reviews

Related concepts

Episodes and papers for this topic live on the concept pages.

Evaluation & Benchmarks LLM Behavior Analysis Human-AI Interaction LLM-as-Judge Ablation Studies Persona Prompting Capability vs. Propensity Behavioral Fingerprinting Mode Collapse Reward Hacking AI & Security AI Text Detection Out-of-Distribution Attack Adversarial Fine-Tuning