Definition
Plain language
An AI that takes in camera images and an instruction and directly outputs robot motor commands.
As stated in the literature
VLA — a model mapping pixels plus a natural-language instruction straight to low-level robot actions, end to end; contrasted with code-writing agents that compose modular tool calls.
Also called: VLA, VLAs, vision-language-action models
Why it matters: By going straight from images and words to motor commands, it skips hand-built modules, but that end-to-end style can be brittle on unfamiliar tasks.
For example, shown a cluttered desk and told 'hand me the red mug,' it outputs the arm movements to do it directly.
Heard on the show
“And for context on how hard these benchmarks are — the end-to-end alternatives, the big vision-language-action models that map pixels-plus-instruction straight to motion, basically fall over here.”Episode 161 — A Robot That Plays Before You Give It a Job, And Why That Beats Retrying