Definition
Plain language
The part of an AI that turns an image into a compact set of numbers capturing what's in it.
As stated in the literature
A pretrained network mapping images to embeddings; in Orca a frozen vision encoder supplies the target latents, tethering the learned world-state to an existing semantic space.
Also called: vision encoders
Why it matters: It gives the rest of a system a compact, meaningful handle on images, so downstream parts can reason about what's in a picture without processing raw pixels.
For example, a vision encoder turns a photo of a cat on a couch into a list of numbers that capture 'cat,' 'couch,' and their arrangement.
Heard on the show
“And the result I'm watching for is someone running this recipe on a vision encoder that isn't Qwen's.”Episode 242 — Making a Vision Model Better by Showing It Blurry Images