validation gate

Definition

A strict check that only lets an edit through if it actually makes things better on a held-out test.

In SkillOpt, a hard acceptance rule applying candidate edits only when they strictly improve performance on a held-out selection split, preventing eloquent-but-harmful revisions.

Mentioned in 1 episode

1. 078
   Training a Markdown File: When LLM Self-Improvement Borrows the Discipline of Neural Net Training