Making agent-friendly pages with content negotiation
Vercel just made every page on the web faster for AI agents. Here's why that matters for your infrastructure.
Why it matters
Vercel is shipping content negotiation tooling that lets AI agents fetch pages as markdown instead of HTML, reducing payload sizes by 99% and freeing up context windows. This is infrastructure-level optimization for the agent economy—making it cheaper and faster for thousands of AI products to consume web content at scale.
The key facts
6 to knowHTML payload reduction: 500KB → 3KB (99.37% decrease)
Content negotiation via Accept: text/markdown header standard
Markdown sitemaps enable agent discovery without site-specific knowledge
Implementation via Next.js 16 remote cache and route handlers
Deployed across Vercel blog, changelog, and documentation
Works for any agent sending Accept header—no site-specific configuration needed
Go to the source
Vercel Blogvercel.com
Publisher excerpt: Agents fetch web pages to answer questions, write code, and complete tasks. When an agent requests a page, it gets everything your browser gets, including navigation menus, stylesheets, JavaScript bundles, tracking scripts, and footer links, when all it needs is the structured text on the page.…