embedding

Definition

A list of numbers that represents the meaning of a word or sentence, so the computer can compare meanings mathematically.

A dense vector representation of a discrete input (token, sentence, image patch), learned so that semantic similarity corresponds to vector closeness.

Also called: embeddings

Mentioned in 7 episodes

1. 073
   When Three LLMs Talk to Each Other, Their Ideas Quietly Stop Moving
2. 067
   An AI Just Solved a 1996 Erdős Problem—and the Simplest Agent Won
3. 041
   When the Iteration Teaches the Model to Skip the Iteration
4. 039
   When Smarter Agents Get Fooled by Three Extra Nodes in a Database
5. 037
   Why Hallucination Detectors Miss Stale Facts: A Geometric Story About What Models Know But Don't Say
6. 019
   When the Best Reward Model Trains the Worst Policy: Inside EvoLM
7. 002
   An AI Ran a Real Optics Lab for 21 Hours and Found a Transformer-Shaped Pattern in Light

Related concepts