ToolsThe story, in brief

WebSocket support for OpenAI Responses API live on AI Gateway

40% faster. That's what Vercel's AI Gateway just delivered for agentic workflows with WebSocket support on OpenAI's Responses API.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Vercel shipped WebSocket mode for the Responses API on AI Gateway, enabling persistent connections that reduce overhead for multi-turn agentic applications. This is a backend infrastructure optimization that directly impacts latency and cost for production AI agents at scale.

The key facts

6 to know
  1. WebSocket support now live on Vercel AI Gateway for OpenAI Responses API

  2. ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20+ tool calls

  3. Persistent connection eliminates need to re-send full context on each turn

  4. Compatible with store=false and Zero Data Retention modes

  5. Follows OpenAI's upstream specification

  6. GET /v1/responses route accepts raw response.create frames over WebSocket

Go to the source

Vercel Blogvercel.com

Publisher excerpt: now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus , instead of re-sending the full context over a fresh HTTP request every turn.AI Gatewayprevious_response_id up to ~40% faster end-to-end…
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools