Definition
Plain language
Google's family of open-weight smaller language models.
As stated in the literature
Google's series of open-weight language models in the few-billion-parameter range, used widely in interpretability and academic research.
Also called: Gemma-2, Gemma-3, Gemma three, Gemma-3-12B
Why it matters: Open-weight small models like Gemma are what makes most interpretability and academic AI research possible.
For example, researchers studying how transformers store factual knowledge often pick a Gemma 2B model because the weights are open and the size is manageable on a single GPU.
Heard on the show
“Pick a model — we'll use the two-billion-parameter Gemma as the running example, that's Google's small open model — and run it through two completely separate tasks.”Episode 004 — The Sycophancy Circuit That Survives Alignment Training