Glossary · Term

asyncio

← all terms

Definition

Plain language

Python's standard library for running many tasks at once.

As stated in the literature

Python's standard concurrency framework for cooperative multitasking via coroutines and event loops, used to launch parallel agent sub-tasks in recursive frameworks like RAO.

Also called: asyncio.gather

Why it matters: Most LLM workloads are I/O-bound, so asyncio is the standard way to get usable throughput out of agent systems in Python.

For example, with asyncio you can launch ten LLM calls simultaneously and gather their results when they all finish, instead of waiting for each in turn.

Heard on the show

“… the agent wants to launch three children in parallel it just uses ordinary Python concurrency — asyncio dot gather, the same thing any working Python developer reaches for. …”
Episode 028 — Teaching a Model to Hire Copies of Itself: Recursive Agent Optimization

Mentioned in 1 episode

  1. 028
    Teaching a Model to Hire Copies of Itself: Recursive Agent Optimization

Related terms