Glossary · Term

Wikidata

← all terms

Definition

Plain language

A large open database of structured facts about the world, used to build benchmarks for testing whether AI assistants notice when facts have gone out of date.

As stated in the literature

The Wikimedia Foundation's structured knowledge base providing typed entity-relation tuples; used as the source of factual claims in temporal drift and knowledge-staleness benchmarks like STALE.

Why it matters: Its structured, dated facts make it a goldmine for building tests of how well models handle changing world knowledge.

For example, a benchmark might pull tuples like '(Paris, mayor, Anne Hidalgo)' from Wikidata and check whether an AI notices when this fact is out of date.

Heard on the show

“Four relation types from Wikidata.”
Episode 037 — Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say

Mentioned in 1 episode

  1. 037
    Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say

Related concepts

Related terms