Definition
LLM behavior analysis is the broad project of characterizing what models do across inputs — capabilities, failure modes, biases, persona shifts — treating the model as a black-box object of empirical study. It’s how most safety-relevant claims about a model actually get grounded.
Episodes covering this
Worth reading next
Papers we haven't done a deep dive on yet, but would recommend on this topic.
- Sycophancy to Subterfuge: Investigating Reward Tampering in Language Models
- Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting
- Universal and Transferable Adversarial Attacks on Aligned Language Models
- Toolformer: Language Models Can Teach Themselves to Use Tools
- Alignment faking in large language models
- Whose Opinions Do Language Models Reflect?
- Towards Understanding Sycophancy in Language Models