ToolsThe story, in brief

Service tiers now available on AI Gateway

Vercel's AI Gateway now lets you pick your price-speed tradeoff. Priority tier costs 1.8-2x more. Flex tier cuts costs in half.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Vercel democratizes compute tier selection for AI inference, letting builders optimize for latency vs. cost per request across OpenAI and Gemini without provider lock-in. This shifts economics for cost-sensitive production deployments.

The key facts

6 to know
  1. Service tiering live on AI Gateway for OpenAI and Gemini models

  2. Three tiers: default (baseline), priority (~1.8-2x cost, faster), flex (~0.5x cost, higher latency)

  3. Works across Chat Completions, Anthropic Messages, OpenAI Responses APIs

  4. Billing adjusts per-request based on actual tier applied; fallback to default tier at default rate

  5. Tier selection via serviceTier under providerOptions.gateway, unified across all supported providers

  6. Applied tier returned in provider metadata for request-level confirmation

Go to the source

Vercel Blogvercel.com

Publisher excerpt: AI Gateway now supports service tiering. Service tiers let you optimize for latency, throughput, and cost per request to match your use case. Pick a faster tier for interactive workloads (less queueing, higher token throughput), or a lower cost tier for background jobs that can tolerate more…
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools