Gemma

Definition

Google's family of open-weight smaller language models.

Google's series of open-weight language models in the few-billion-parameter range, used widely in interpretability and academic research.

Also called: Gemma-2, Gemma-3, Gemma three, Gemma-3-12B

Mentioned in 8 episodes

1. 074
   How a Fifteen-Hundred-Dollar Training Run Matched Llama and Gemma on Reasoning
2. 055
   Why LLM Judges Flip Their Verdicts When You Change the Question Format
3. 038
   How LLMs Get Persuaded: One Attention Head, A Tetrahedron, And A Single Dial
4. 037
   Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
5. 032
   A Sticky-Note for Every Layer: Letting Transformers Remember What They Were Just Thinking
6. 013
   Why Search Keeps Rediscovering the Same Workflow, and What That Means
7. 008
   Why Long-Horizon AI Agents Get Stuck, and a Milestone-Based Fix That Helps
8. 004
   The Sycophancy Circuit That Survives Alignment Training