--- title: Azure API Management Adds Dedicated AI Gateway Tier,... description: Microsoft has released a dedicated AI Gateway tier of Azure API Management in public preview, designed around models, MCP servers, and tools rather than... canonical: https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools | daily.dev og:description: Microsoft has released a dedicated AI Gateway tier of Azure API Management in public preview, designed around models, MCP servers, and tools rather than... og:url: https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw og:image: https://api.daily.dev/og/posts/cx4kwhECW.png og:image:alt: Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools **[InfoQ](https://daily.dev/sources/infoq)** · 5 min read · 1 upvotes · 0 comments ## Summary Microsoft has released a dedicated AI Gateway tier of Azure API Management in public preview, designed around models, MCP servers, and tools rather than traditional APIs. It unifies access to Azure AI Foundry, AWS Bedrock, Google Vertex AI, and OpenAI behind a single endpoint, routing requests by model name. Policies are configured via portal cards instead of XML, covering token limits, quotas, content safety, and model fallback. MCP tool federation supports remote MCP servers, OpenAPI specs, and built-in SaaS connectors. Telemetry exports as OpenTelemetry metrics to Application Insights, Datadog, and Grafana. Architects have welcomed the consolidation but raised concerns about agent lifecycle governance, key blast radius (runtime keys are gateway-scoped rather than per-API), and unclear migration paths for teams already using AI gateway capabilities on existing APIM tiers. The tier is available in East US 2 and Sweden Central, free during preview, with no published SLA or pricing. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is the Azure API Management AI Gateway tier and how is it different from existing AI gateway capabilities? It is a dedicated gateway resource, released in public preview, whose control plane is organized around models, MCP servers, and tools rather than APIs, built as a separate experience rather than another policy layer. It fronts Foundry-hosted models (OpenAI, Anthropic, Mistral), AWS Bedrock, Google Vertex AI, and OpenAI directly behind one endpoint, using policy cards instead of XML, while the classic and v2 tiers retain their existing AI gateway capabilities. _Teams evaluating multi-provider LLM gateways can track Azure's rollout and governance debates on daily.dev._ ### How is authentication and access scoped in the new Azure AI Gateway tier for tools and runtime keys? A runtime access key is gateway-scoped, reaching every model and tool published on that gateway, rather than being scoped to a single application or API set as APIM subscriptions traditionally allow. Microsoft recommends one key per application, but a leaked key exposes the entire gateway's blast radius, and per-tool backends can authenticate via none, API key, OAuth 2.0, or managed identity. _Architects weighing key-scoping tradeoffs for AI gateways can follow this governance debate on daily.dev._ ### How does Azure's new AI Gateway tier compare to Databricks Unity AI Gateway for governing AI agents and models? Databricks Unity AI Gateway, announced at Data + AI Summit, extends Unity Catalog to govern models, agents, MCP services, and skills at runtime with hard spend caps, smart routing, content guardrails, and routing for external coding agents like Claude Code and Codex, while Azure's equivalent tier just entered preview without published pricing or SLA, though Microsoft has offered other AI gateway capabilities for roughly two years. _Anyone choosing between cloud AI gateway offerings can compare vendor tradeoffs surfaced on daily.dev._ ## Similar posts on daily.dev - [AI Gateway: A Governance Layer for Agentic AI](https://daily.dev/posts/ai-gateway-a-governance-layer-for-agentic-ai-g2beye649) · databricks · 1 upvotes · 0 comments - [API gateway vs AI gateway: Where AI governance meets execution](https://daily.dev/posts/api-gateway-vs-ai-gateway-where-ai-governance-meets-execution-rizfx4nv6) · The Next Web · 0 upvotes · 0 comments - [API Gateways, AI Gateways, and MCP Gateways: Are Enterprises About to Pay Twice Again?](https://daily.dev/posts/api-gateways-ai-gateways-and-mcp-gateways-are-enterprises-about-to-pay-twice-again--vg8t9rdi1) · Nordic APIs · 0 upvotes · 0 comments - [Portkey open-sources its AI gateway after processing 2 trillion tokens a day](https://daily.dev/posts/portkey-open-sources-its-ai-gateway-after-processing-2-trillion-tokens-a-day-wludkfkk7) · The New Stack · 1 upvotes · 0 comments --- Tags: [#azure](https://daily.dev/tags/azure), [#mcp](https://daily.dev/tags/mcp), [#ai-gateway](https://daily.dev/tags/ai-gateway) [View this post on daily.dev](https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools","url":"https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw"},"datePublished":"2026-08-07T06:45:18.601Z","dateModified":"2026-09-14T06:40:31.875Z","description":"Microsoft has released a dedicated AI Gateway tier of Azure API Management in public preview, designed around models, MCP servers, and tools rather than...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/72f350355042db7f73cb9f8b551c25fe?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/72f350355042db7f73cb9f8b551c25fe?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"InfoQ","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"InfoQ","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/afc3bced3e1e4b188dd9127017a60e0c","url":"https://daily.dev/sources/infoq"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"azure,mcp,ai-gateway","timeRequired":"PT5M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"InfoQ","item":"https://daily.dev/sources/infoq"},{"@type":"ListItem","position":3,"name":"Azure API Management Adds Dedicated AI Gateway Tier, Governing Models and MCP Tools"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/azure-api-management-adds-dedicated-ai-gateway-tier-governing-models-and-mcp-tools-cx4kwhecw#faq","mainEntity":[{"@type":"Question","name":"What is the Azure API Management AI Gateway tier and how is it different from existing AI gateway capabilities?","acceptedAnswer":{"@type":"Answer","text":"It is a dedicated gateway resource, released in public preview, whose control plane is organized around models, MCP servers, and tools rather than APIs, built as a separate experience rather than another policy layer. It fronts Foundry-hosted models (OpenAI, Anthropic, Mistral), AWS Bedrock, Google Vertex AI, and OpenAI directly behind one endpoint, using policy cards instead of XML, while the classic and v2 tiers retain their existing AI gateway capabilities. Teams evaluating multi-provider LLM gateways can track Azure's rollout and governance debates on daily.dev."}},{"@type":"Question","name":"How is authentication and access scoped in the new Azure AI Gateway tier for tools and runtime keys?","acceptedAnswer":{"@type":"Answer","text":"A runtime access key is gateway-scoped, reaching every model and tool published on that gateway, rather than being scoped to a single application or API set as APIM subscriptions traditionally allow. Microsoft recommends one key per application, but a leaked key exposes the entire gateway's blast radius, and per-tool backends can authenticate via none, API key, OAuth 2.0, or managed identity. Architects weighing key-scoping tradeoffs for AI gateways can follow this governance debate on daily.dev."}},{"@type":"Question","name":"How does Azure's new AI Gateway tier compare to Databricks Unity AI Gateway for governing AI agents and models?","acceptedAnswer":{"@type":"Answer","text":"Databricks Unity AI Gateway, announced at Data + AI Summit, extends Unity Catalog to govern models, agents, MCP services, and skills at runtime with hard spend caps, smart routing, content guardrails, and routing for external coding agents like Claude Code and Codex, while Azure's equivalent tier just entered preview without published pricing or SLA, though Microsoft has offered other AI gateway capabilities for roughly two years. Anyone choosing between cloud AI gateway offerings can compare vendor tradeoffs surfaced on daily.dev."}}]} ```