ToolsThe story, in brief

Bot activity and crawler insights now in Observability

Vercel now lets you see exactly which AI crawlers are hitting your infrastructure—and how much traffic they're actually consuming.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

As AI training data scraping becomes a major operational concern, Vercel is giving developers visibility into bot and crawler activity, including AI crawlers. This is a product feature that addresses a real pain point for founders managing infrastructure costs and data usage.

The key facts

10 to know
  1. Vercel Observability now provides detailed breakdowns for individual bots and bot categories

  2. AI crawlers and search engines included in reporting

  3. Available to all users in Edge Requests dashboard

  4. Observability Plus users can filter traffic by bot category, inspect individual bot activity, and break down traffic in query builder

  5. Feature addresses growing concern over AI crawler resource consumption and data scraping

  6. Vercel Observability now tracks individual bots and bot categories

  7. All plan tiers can view bot/crawler breakdown in Edge Requests dashboard

  8. Observability Plus users can filter traffic by bot category (including AI crawlers)

  9. Feature includes per-bot metrics and query builder filtering

  10. Launched May 7, 2025

Go to the source

Vercel Blogvercel.com

Publisher excerpt: Vercel Observability now provides detailed breakdowns for and , including AI crawlers and search engines. Users across all plans can view this data in the dashboard.individual botsbot categoriesObservability > Edge Requests Additionally, Observability Plus users can: Inspect bot and crawler…
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools