ToolsThe story, in brief

Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools

Microsoft collapses multi-cloud AI model routing into one API Management tier—unifying OpenAI, Bedrock, Vertex, and Foundry behind policy cards instead of XML.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Practitioners managing models across cloud vendors now have a unified governance layer for routing, rate-limiting, and policy enforcement. This reduces operational friction for multi-model deployments but raises questions about where governance responsibility ends—a critical decision point for enterprise teams standardizing on Azure.

The key facts

6 to know
  1. Azure API Management launches dedicated AI Gateway tier (public preview)

  2. Unified control plane for models, MCP servers, and tools (not traditional APIs)

  3. Supports Foundry, Bedrock, Vertex AI, and OpenAI endpoints from single gateway

  4. Policy cards interface replaces XML configuration

  5. Architects question governance boundary definition

  6. Consolidation benefit: single endpoint for multi-cloud model access

Go to the source

InfoQ AI/MLinfoq.com

Publisher excerpt: Microsoft released a dedicated AI Gateway tier of Azure API Management in public preview, with a control plane built around models, MCP servers and tools rather than APIs. It fronts Foundry, Bedrock, Vertex AI and OpenAI behind one endpoint, with policy cards instead of XML. Architects welcomed the…
Read original report
Back to today's editionMore tools news

The wider picture

View all
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Tools01

Dynamic model routing will follow the path blazed by software-defined wide-area networks

Dynamic model routing — intelligently directing requests across multiple AI models based on cost, latency, and capability — is moving from niche optimization to mainstream infrastructure. Stripe's acquisition validates the category and signals that enterprises will soon expect this routing logic as table stakes, much like SD-WAN did for networking.

SiliconAngle
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Tools02

llm-keys-ui 0.1

A lightweight, open utility that simplifies credential and API key management for developers running LLMs locally or against multiple providers — practical infrastructure for the growing DIY AI stack.

Simon Willison
Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
AI illustration by KeyNews
Tools03

Vocci’s ring adds a new form factor to meeting note-taking

A new form factor for AI-powered meeting capture that practitioners evaluating note-taking workflows need to consider — hardware, pricing, and the data-collection footprint all factor into adoption decisions.

TechCrunch AI