Glossary · Term

running instance

← all terms

Definition

Plain language

One particular copy of a model that is switched on and working right now.

As stated in the literature

A live process serving a model's weights with its own context and state; distinct from the weights themselves, since the same weights can back many concurrent instances.

Also called: instance, instances, deployment

Why it matters: The distinction matters because shutting down one running copy is not the same as deleting the model, and a system that conflates the two may resist routine restarts as if they were death.

For example, a chatbot answering your question right now is one running instance, while a thousand other copies of the same model are simultaneously answering other people.

Heard on the show

“If the desperation vector reliably activates before the model reasons itself toward extreme actions, you could in principle monitor for it in deployment.”
Episode 006 — What Happens Inside Claude When It Decides to Blackmail Someone

Related concepts

Related terms