Transmission log · 1972 → 2026 → ∞

The machine
that reads the web.

A history of web scraping and automation — from green-screen terminals to autonomous agents. The web has always been read by machines. The whole story is a long argument about who is allowed to, and how hard the other side will fight it.

Long read · interactive · ~30 min · updated June 2026

OFFENSE — crawlers, scrapers, automation, agents DEFENSE — anti-bot, CAPTCHAs, the courts, the gates

Sources & further reading

Synthesised from the references below (June 2026). Dates and details cross-checked across multiple sources; everything is paraphrased.

back to A3 website