Glossary · Term

nucleus sampling

← all terms

Definition

A way of generating text that only picks from the most likely next-word candidates, ignoring the long tail.

A decoding method that samples from the smallest set of tokens whose cumulative probability exceeds a threshold p, also called top-p sampling.

Mentioned in 1 episode

  1. 010
    When Reward Climbs But Reasoning Goes Generic: Diagnosing Template Collapse in Agentic RL