Definition
Plain language
A theoretical self-improving program that rewrites its own code, but only after it can prove the change will actually make it better.
As stated in the literature
Schmidhuber's proposed self-referential agent that searches for provably beneficial rewrites of its own code and applies them only once a proof of improvement is found; the conceptual ancestor of recursive-self-improvement discussions and a forerunner to scaffold-editing systems like the Darwin Gödel Machine.
Why it matters: It frames the idea of safe self-improvement, where a system upgrades itself only when it can guarantee the change helps rather than hurts.
For example, such a program would only rewrite part of its own code once it could mathematically prove the new version would perform better than the old one.
Heard on the show
“… technical term tap-to-define, with links to the related papers grouped by theme, so you can trace the Gödel Machine lineage and the self-preference-bias work yourself, plus our weekly and monthly roundups. …”Episode 178 — How an AI Reviewer Learned to Stop Going Easy on AI Writing