--- title: Introducing the ngrok AI gateway (early access) | daily.dev description: ngrok has opened early access to its AI gateway, a single endpoint that routes requests across OpenAI, Anthropic, Google, DeepSeek, OpenRouter, and self-hosted... canonical: https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Introducing the ngrok AI gateway (early access) | daily.dev og:description: ngrok has opened early access to its AI gateway, a single endpoint that routes requests across OpenAI, Anthropic, Google, DeepSeek, OpenRouter, and self-hosted... og:url: https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf og:image: https://api.daily.dev/og/posts/CDxRCoEAf.png og:image:alt: Introducing the ngrok AI gateway (early access) og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Introducing the ngrok AI gateway (early access) **[ngrok Blog](https://daily.dev/sources/ngrok)** · 4 min read · 0 upvotes · 0 comments ## Summary ngrok has opened early access to its AI gateway, a single endpoint that routes requests across OpenAI, Anthropic, Google, DeepSeek, OpenRouter, and self-hosted models like Ollama, vLLM, and LM Studio. It offers automatic failover, API key rotation, CEL-based model selection, traffic modification (PII redaction, prompt injection), and works with any OpenAI-compatible SDK. New accounts get $1 in credit, and the team is soliciting feedback to shape upcoming features like a dashboard and cost analytics. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How can I add automatic failover between OpenAI and Anthropic without writing my own retry logic? Point an OpenAI-compatible SDK at ngrok's AI gateway endpoint and configure OpenAI as the primary provider with Anthropic as backup; the gateway automatically retries with the backup provider if the primary fails. It also supports rotating across multiple API keys for the same provider when one hits rate limits, and works with the OpenAI SDK, Vercel AI SDK, and LangChain. _Developers comparing gateway approaches for multi-provider LLM failover can track new tooling like this via daily.dev._ ### Can I route some AI requests to a locally hosted Ollama model and others to a cloud provider from the same app? Yes, ngrok's AI gateway supports mixing cloud and local inference in the same configuration by routing to self-hosted endpoints like Ollama, vLLM, LM Studio, or any OpenAI-compatible custom provider, alongside cloud providers such as OpenAI, Anthropic, and Google, using CEL expressions to control selection logic. _Teams weighing local versus cloud inference setups can follow gateway tooling updates on daily.dev._ ## Similar posts on daily.dev - [OpenRouter: One API Key to Rule Them All](https://daily.dev/posts/openrouter-one-api-key-to-rule-them-all-ektckqyxv) · Playful Programming · 0 upvotes · 0 comments - [Introducing Convex AI Gateway: get to the model call](https://daily.dev/posts/introducing-convex-ai-gateway-get-to-the-model-call-jqblbys4w) · Convex · 0 upvotes · 0 comments --- Tags: [#devtools](https://daily.dev/tags/devtools), [#openai](https://daily.dev/tags/openai), [#ai-gateway](https://daily.dev/tags/ai-gateway) [View this post on daily.dev](https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Introducing the ngrok AI gateway (early access)","url":"https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf"},"datePublished":"2026-08-23T07:21:13.628Z","dateModified":"2026-08-23T07:23:01.820Z","description":"ngrok has opened early access to its AI gateway, a single endpoint that routes requests across OpenAI, Anthropic, Google, DeepSeek, OpenRouter, and self-hosted...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/209c022d9e77998f2013f94e7ba1d6f3?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/209c022d9e77998f2013f94e7ba1d6f3?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"ngrok Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ngrok Blog","logo":"https://media.daily.dev/image/upload/s--718XXxvE--/f_auto,q_auto/v1787469610/logos/ngrok?_a=BAMAMicg0","url":"https://daily.dev/sources/ngrok"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devtools,openai,ai-gateway","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ngrok Blog","item":"https://daily.dev/sources/ngrok"},{"@type":"ListItem","position":3,"name":"Introducing the ngrok AI gateway (early access)"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/introducing-the-ngrok-ai-gateway-early-access--cdxrcoeaf#faq","mainEntity":[{"@type":"Question","name":"How can I add automatic failover between OpenAI and Anthropic without writing my own retry logic?","acceptedAnswer":{"@type":"Answer","text":"Point an OpenAI-compatible SDK at ngrok's AI gateway endpoint and configure OpenAI as the primary provider with Anthropic as backup; the gateway automatically retries with the backup provider if the primary fails. It also supports rotating across multiple API keys for the same provider when one hits rate limits, and works with the OpenAI SDK, Vercel AI SDK, and LangChain. Developers comparing gateway approaches for multi-provider LLM failover can track new tooling like this via daily.dev."}},{"@type":"Question","name":"Can I route some AI requests to a locally hosted Ollama model and others to a cloud provider from the same app?","acceptedAnswer":{"@type":"Answer","text":"Yes, ngrok's AI gateway supports mixing cloud and local inference in the same configuration by routing to self-hosted endpoints like Ollama, vLLM, LM Studio, or any OpenAI-compatible custom provider, alongside cloud providers such as OpenAI, Anthropic, and Google, using CEL expressions to control selection logic. Teams weighing local versus cloud inference setups can follow gateway tooling updates on daily.dev."}}]} ```