Definition
Inference-time scaffolding is everything you add around a model at run time to make it more capable: tools, retrieval, verifiers, planners, parallel samples, voting. It can dramatically change effective capability without touching the underlying weights.
Episodes covering this
Worth reading next
Papers we haven't done a deep dive on yet, but would recommend on this topic.