Glossary · Term

vision encoder

← all terms

Definition

Plain language

The part of an AI that turns an image into a compact set of numbers capturing what's in it.

As stated in the literature

A pretrained network mapping images to embeddings; in Orca a frozen vision encoder supplies the target latents, tethering the learned world-state to an existing semantic space.

Also called: vision encoders

Why it matters: It gives the rest of a system a compact, meaningful handle on images, so downstream parts can reason about what's in a picture without processing raw pixels.

For example, a vision encoder turns a photo of a cat on a couch into a list of numbers that capture 'cat,' 'couch,' and their arrangement.

Heard on the show

“And the result I'm watching for is someone running this recipe on a vision encoder that isn't Qwen's.”
Episode 242 — Making a Vision Model Better by Showing It Blurry Images

Mentioned in 4 episodes

  1. 242
    Making a Vision Model Better by Showing It Blurry Images
  2. 213
    A Model Learned to Control a Robot by Watching Video It Never Acted On
  3. 127
    What Diffusion Language Models Were Missing: A Map, Not an Algorithm
  4. 115
    Teaching a Phone Agent to Reason Silently, And Keeping It Honest

Related terms