logits

Definition

The raw numbers a model produces before they get turned into probabilities over words.

The unnormalized scores output by a model's final layer, converted to a probability distribution via softmax.

Also called: logit

Mentioned in 3 episodes

1. 073
   When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
2. 037
   Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
3. 018
   Language Models Compute the Rational Move, Then Override It

Related concepts