Definition
Plain language
Automatically pulling data off websites with a program that reads the pages, rather than a person browsing them.
As stated in the literature
Programmatic extraction of content from web pages, typically by fetching HTML and parsing it; AI agents that scrape aggressively can trigger rate limits and captchas, and may incur legal exposure under statutes like the CFAA.
Also called: scraping, scrape, scrapes, scraped
Why it matters: It enables fast, large-scale data collection, but doing it aggressively can get an agent blocked, throttled, or even into legal trouble.
For example, a program might automatically visit hundreds of product pages and pull out every price into a spreadsheet without a person clicking through them.
Heard on the show
“Skills born from clean solves rate high; skills scraped from partial reasoning inside failures rate low but stay in the bank.”Episode 186 — How a Frozen Model Went From 2% to 77% on Physics Puzzles — Without Retraining