Concept · 3 episode(s)

Context Leakage

← all concepts

Definition

Context leakage is the phenomenon where information held in a model's context — including instructions or facts it has been told to keep hidden — measurably influences its outputs even though that information is never explicitly repeated in the generated text. It matters because it shows that hiding a secret from the visible output is not enough to prevent it from leaving statistical traces in word choice, confidence, or structure that can be probed or extracted.

Episodes covering this

Worth reading next

Papers we haven't done a deep dive on yet, but would recommend on this topic.