Nemotron

Definition

NVIDIA's family of hybrid foundation models that mix attention with state-space layers.

NVIDIA's hybrid SSM/Transformer model family used as a comparison baseline for agent-discovered architectures in AIRA-Compose isoFLOP analysis.

Mentioned in 3 episodes

1. 053
   An AI Agent Swapped In Focal Loss And Beat A Human-Tuned Training Script
2. 033
   Echo: The Paper Arguing You Never Needed a KV Cache for Retrieval
3. 027
   When AI Agents Build the Serving Stack: A Bet on Bespoke Infrastructure