Definition
Plain language
A perfect yes-or-no answerer that tells you whether a given item belongs in the set — but only for items you think to ask about.
As stated in the literature
An idealized query interface returning exact set membership for named candidates; even a flawless one cannot certify completeness, since undetected omissions lie outside the queried support.
Also called: membership oracles
Why it matters: It shows that being flawless at checking individual items still leaves you unable to prove nothing is missing, which is exactly the gap that sinks list-building tasks.
For example, you can ask the oracle "is 7 in the set?" and get a perfect yes, but it will never volunteer that you forgot to ask about 11.
Heard on the show
“Give a reviewer a perfect membership oracle — a flawless judge — but they can only query candidates they can name, on a budget smaller than the universe of things not written down.”Episode 233 — Why a Model Can Grade an Answer But Not Write the Answer Key