Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools
Microsoft collapses multi-cloud AI model routing into one API Management tier—unifying OpenAI, Bedrock, Vertex, and Foundry behind policy cards instead of XML.
Why it matters
Practitioners managing models across cloud vendors now have a unified governance layer for routing, rate-limiting, and policy enforcement. This reduces operational friction for multi-model deployments but raises questions about where governance responsibility ends—a critical decision point for enterprise teams standardizing on Azure.
The key facts
6 to knowAzure API Management launches dedicated AI Gateway tier (public preview)
Unified control plane for models, MCP servers, and tools (not traditional APIs)
Supports Foundry, Bedrock, Vertex AI, and OpenAI endpoints from single gateway
Policy cards interface replaces XML configuration
Architects question governance boundary definition
Consolidation benefit: single endpoint for multi-cloud model access
Go to the source
InfoQ AI/MLinfoq.com
Publisher excerpt: Microsoft released a dedicated AI Gateway tier of Azure API Management in public preview, with a control plane built around models, MCP servers and tools rather than APIs. It fronts Foundry, Bedrock, Vertex AI and OpenAI behind one endpoint, with policy cards instead of XML. Architects welcomed the…