Definition
Plain language
How much a system can learn from a small amount of data or few attempts.
As stated in the literature
The degree to which a training method reaches good performance with few examples or rollouts; targeted per-step rewards are reported to improve it severalfold over end-of-task-only signals.
Also called: sample-efficient, sample-efficiency
Why it matters: Higher sample efficiency means less data, time, and compute to reach good performance, which makes training cheaper and faster.
For example, one training method might master a task after a handful of attempts while another needs thousands.
Heard on the show
“The nice side effect: it made training something like five to six times more sample-efficient.”Episode 104 — How Making a Research Agent Smarter Quietly Makes It Leak Your Secrets