ToolsThe story, in brief

New one-click AI bot managed ruleset

One click to block GPTBot, ClaudeBot, and 10+ AI crawlers. Vercel just turned AI bot defense into a commodity.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

As AI crawlers now exceed human traffic on major sites, Vercel's managed ruleset solves a growing operational headache for developers—and signals a shift in how the industry handles data scraping friction at scale.

The key facts

7 to know
  1. AI crawlers now generate more traffic than human users on many popular sites

  2. Blocks GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Bytespider (ByteDance), and others

  3. Zero latency impact to legitimate traffic

  4. Automatically updates as new crawlers appear

  5. Available free on all Vercel plans

  6. Ruleset managed by Vercel with no manual intervention required

  7. Can be combined with Bot Filter to catch spoofed user agents

Go to the source

Vercel Blogvercel.com

Publisher excerpt: You can now block AI crawlers and scrapers like GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Bytespider (ByteDance), and others with a single toggle using the AI bot managed ruleset. Now available for free on all plans. The ruleset is managed by Vercel and updates automatically as new…
Read original report
Back to today's editionMore tools news

The wider picture

View all
Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
AI illustration by KeyNews
Tools01

The Genie One MCP is now Generally Available

Genie One MCP is a production-ready tool layer for integrating coding agents into enterprise workflows. Practitioners building agentic systems now have a standardized, vendor-backed protocol for connecting agents to IDEs and development environments — lowering friction from pilot to deployment.

Databricks
Illustration of independent geometric mechanisms passing paper tasks along branching amber tracks.
AI illustration by KeyNews
Tools02

Rabbit Is Back, This Time With an AI Agent App

A failed AI hardware play pivots to cross-platform agent software — a test case for whether agent UX can drive mainstream adoption outside dedicated devices.

Wired AI
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Tools03

llm-typesafe 0.1a0

A new Python library for enforcing type-safe outputs from LLMs—useful for practitioners building production applications where unpredictable output shapes break downstream code. Early alpha, but addresses a real friction point in AI app development.

Simon Willison