ToolsThe story, in brief

New one-click AI bot managed ruleset

One click to block GPTBot, ClaudeBot, and 10+ AI crawlers. Vercel just turned AI bot defense into a commodity.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

As AI crawlers now exceed human traffic on major sites, Vercel's managed ruleset solves a growing operational headache for developers—and signals a shift in how the industry handles data scraping friction at scale.

The key facts

7 to know
  1. AI crawlers now generate more traffic than human users on many popular sites

  2. Blocks GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Bytespider (ByteDance), and others

  3. Zero latency impact to legitimate traffic

  4. Automatically updates as new crawlers appear

  5. Available free on all Vercel plans

  6. Ruleset managed by Vercel with no manual intervention required

  7. Can be combined with Bot Filter to catch spoofed user agents

Go to the source

Vercel Blogvercel.com

Publisher excerpt: You can now block AI crawlers and scrapers like GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Bytespider (ByteDance), and others with a single toggle using the AI bot managed ruleset. Now available for free on all plans. The ruleset is managed by Vercel and updates automatically as new…
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools