WorkThe story, in brief
Cloudflare CEO says the web's future is "pay to crawl" as bots overtake human traffic
Bot traffic just overtook human traffic on the web—years ahead of schedule. Cloudflare's CEO says the answer is 'pay to crawl.'
The KeyNews take
Why it matters
AI agents are consuming the internet faster than anyone predicted, forcing a fundamental rethinking of how web economics work. This signals a shift from ad-driven models to direct monetization of data access.
The key facts
5 to knowBot traffic now exceeds human traffic on the internet
Cloudflare CEO Matthew Prince attributes surge to AI agents
Forecast for bot-dominated internet was late 2027; occurred years earlier
Prince's proposed model: 'pay to crawl' access to web data
Implies future web infrastructure monetization tied to agent access
Go to the source
The Decoderthe-decoder.com
Publisher excerpt: Bot traffic now outpaces human traffic on the internet, Cloudflare CEO Matthew Prince says, years ahead of his late 2027 forecast. He blames AI agents for the surge. His conclusion for the future of the web: "Clearly it's going to be pay to crawl."