ToolsThe story, in brief

Google checks websites for llms.txt in new agentic browsing audit

Google just added 'Agentic Browsing' to Lighthouse. Your website might already be failing the audit.

Illustration of a transparent lens revealing connected networks across layers of paper.
Exploring the next frontier of AI research.AI illustration by KeyNews
The KeyNews take

Why it matters

Google is instrumentalizing agent compatibility as a measurable web standard, signaling that agentic crawling is now a first-class concern for developers—not a future possibility but a present requirement for SEO and performance evaluation.

The key facts

9 to know
  1. Google testing 'Agentic Browsing' category in Lighthouse

  2. New audit checks for llms.txt file support

  3. Agent compatibility now part of official web audit tooling

  4. Implies standardization of AI agent crawling as web best practice

  5. Published May 21, 2026

  6. Google Lighthouse adds 'Agentic Browsing' experimental category

  7. llms.txt file format now auditable through developer tools

  8. May 2026 release date

  9. Affects website architecture for AI agent compatibility

Go to the source

The Decoderthe-decoder.com

Publisher excerpt: Google is testing how well websites handle AI agents through a new experimental category called "Agentic Browsing" in its Lighthouse analysis tool.
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools