Platform WatchJune 29, 2026via Vercel Blog

xAI Grok audio models now available on Vercel AI Gateway

Why it matters

xAI expands multimodal reach by making voice capabilities available through a major developer platform (Vercel), lowering integration friction for builders deploying voice agents at scale.

Key signals

  • xAI Grok audio models now live on Vercel AI Gateway
  • Three capabilities available: realtime voice (xai/grok-voice-think-fast-1.0), text-to-speech (xai/grok-tts), speech-to-text (xai/grok-stt)
  • Integration available via AI SDK 7 release
  • Includes routing, observability, and spend controls
  • Browser component with token-based auth (API key never reaches client)
  • Playground available for direct model testing
  • Voice agent architecture: server route + browser component with WebSocket connection

The hook

xAI's Grok audio models just shipped on Vercel AI Gateway. Realtime voice, TTS, and STT are live—with the same routing and observability as your other models.

are now live on AI Gateway. Realtime voice, text to speech, and speech to text are all available through the with the same routing, observability, and spend controls as your other models.xAI's audio modelsAI SDK These capabilities are available on the AI SDK 7 release. A voice agent has two pieces: a server route that mints a short-lived token, so your API key never reaches the client, and a browser component that connects with it. Add the token route: this example sets to :modelxai/grok-voice-think-fast-1.0 Then connect from the browser. The hook from fetches that route and manages the WebSocket connection, microphone capture, and audio playback:useRealtime@ai-sdk/react Generate from text with . Pass a voice and an output format, then write the result to a file with :spoken audiogenerateSpeechxai/grok-tts recordings into text with . This example uses :Transcribetranscribexai/grok-stt You can also try the xAI audio models directly in the AI Gateway playground. Open the and click into any of the models to use them directly in the browser. The playground allows you to talk to the agent and see responses instantly:models listherexai/grok-voice-think-fast-1.0 Available models Realtime Text to speech Speech to text Playground Capability Models Realtime voice xai/grok-voice-think-fast-1.0 Text to speech xai/grok-tts Speech to text xai/grok-stt More information Realtime quickstart Speech quickstart See all xAI models

The week's key stories, every Friday.

For practitioners and enthusiasts — free, in your inbox.

Free forever. No spam.