Definition
Context fatigue is the observed degradation in model performance as conversation or document context grows, even within the nominal context window — needles get harder to find, instructions earlier in the prompt get less weight, reasoning gets sloppier. It’s why “long context” on the spec sheet doesn’t always mean “long context that works.”
Episodes covering this
Worth reading next
Papers we haven't done a deep dive on yet, but would recommend on this topic.