k
keynews.ai
keynews.ai
ToolsThe story, in brief

How AI Gateway runs on Fluid compute

Billions of tokens per day. That's what Vercel's AI Gateway processes—and how Fluid compute is enabling the next layer of AI infrastructure.

Reporting by Vercel Blog 1 min brief
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
The infrastructure powering AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Vercel's AI Gateway demonstrates how app-layer infrastructure is evolving to handle AI workloads at scale. This shows the emerging trend of unified model-agnostic APIs becoming critical developer plumbing in the AI economy.

The key facts

9 to know

  1. AI Gateway processes billions of tokens per day

  2. Node.js service connecting to hundreds of AI models

  3. Single interface for multi-model routing

  4. Built on Fluid compute infrastructure

  5. Published Nov 6, 2025

  6. Node.js service abstraction layer for hundreds of AI models

  7. Single interface for multi-model connectivity

  8. Powered by Fluid compute infrastructure

  9. Production deployment at scale case study

Go to the source

Vercel Blogvercel.com

Publisher excerpt: AI Gateway is a Node.js service for connecting to hundreds of AI models through a single interface. It processes billions of tokens per day. The secret behind that scale is Fluid.
Read original report
Back to today's editionMore tools news

The wider picture

View all
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Tools01

Dynamic model routing will follow the path blazed by software-defined wide-area networks

Dynamic model routing — intelligently directing requests across multiple AI models based on cost, latency, and capability — is moving from niche optimization to mainstream infrastructure. Stripe's acquisition validates the category and signals that enterprises will soon expect this routing logic as table stakes, much like SD-WAN did for networking.

SiliconAngle
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Tools02

llm-keys-ui 0.1

A lightweight, open utility that simplifies credential and API key management for developers running LLMs locally or against multiple providers — practical infrastructure for the growing DIY AI stack.

Simon Willison
Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
AI illustration by KeyNews
Tools03

Vocci’s ring adds a new form factor to meeting note-taking

A new form factor for AI-powered meeting capture that practitioners evaluating note-taking workflows need to consider — hardware, pricing, and the data-collection footprint all factor into adoption decisions.

TechCrunch AI