Glossary · Term

RAG

← all terms

Definition

Plain language

Letting a model look things up in an external source and use what it finds to answer.

As stated in the literature

Retrieval-Augmented Generation, an inference pattern where a model retrieves relevant documents from an external store and conditions generation on them.

Also called: RAG poisoning

Why it matters: It lets a model stay accurate on fresh or proprietary information without retraining, and it makes answers auditable since you can see which documents were retrieved.

For example, a customer-support bot looks up the user's order in a database and the relevant help article before composing its reply.

Heard on the show

“" The mental model a lot of people have is retrieval-augmented generation — RAG.”
Episode 082 — Training a Deep Research Agent on 8,000 Synthetic Tasks: The Rubric Tree Trick

Mentioned in 4 episodes

  1. 082
    Training a Deep Research Agent on 8,000 Synthetic Tasks: The Rubric Tree Trick
  2. 039
    When Smarter Agents Get Fooled by Three Extra Nodes in a Database
  3. 031
    When Your AI Assistant Won't Let Go of Old Facts About You
  4. 027
    When AI Agents Build the Serving Stack: A Bet on Bespoke Infrastructure

Related concepts

Related terms