--- title: Endpoint Pools: load balance anything, anywhere | daily.dev description: ngrok has launched Endpoint Pooling, a load balancing feature that activates automatically whenever two or more endpoints share the same URL, regardless of... canonical: https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Endpoint Pools: load balance anything, anywhere | daily.dev og:description: ngrok has launched Endpoint Pooling, a load balancing feature that activates automatically whenever two or more endpoints share the same URL, regardless of... og:url: https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e og:image: https://api.daily.dev/og/posts/5JEM13A5E.png og:image:alt: Endpoint Pools: load balance anything, anywhere og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Endpoint Pools: load balance anything, anywhere **[ngrok Blog](https://daily.dev/sources/ngrok)** · 7 min read · 0 upvotes · 0 comments ## Summary ngrok has launched Endpoint Pooling, a load balancing feature that activates automatically whenever two or more endpoints share the same URL, regardless of whether they run on different machines, clouds, or networks. Endpoints register and deregister from pools automatically with no upfront backend configuration, heartbeats remove unhealthy endpoints, and HTTP/S traffic balances at layer 7 while TCP/TLS balances at layer 4. The feature supports mixed endpoint types (cloud, agent, internal), per-endpoint Traffic Policies for safer canary rollouts, and geo-aware routing to the nearest replica. It works across the CLI, SDKs (Go, Rust, JavaScript, Python), and the Kubernetes Operator, supports up to 1000 endpoints per pool on the pay-as-you-go plan, and is available free to try, with pricing for paid plans expected as early as June. Custom load balancing strategies are not yet available but are planned. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do I set up load balancing with ngrok? Load balancing with ngrok is done by starting two or more endpoints with the same URL; ngrok automatically groups them into an Endpoint Pool and distributes traffic between them via random distribution. Endpoints must have pooling enabled, and mixing pooling-enabled and pooling-disabled endpoints on the same URL causes endpoint creation to fail. No backend list or service registry sync is required. _Developers comparing zero-config load balancers to traditional gateways can follow ngrok updates on daily.dev._ ### Can ngrok load balance traffic across different cloud providers or on-premises servers? Yes, ngrok's Endpoint Pools balance traffic across endpoints running on different networks, regions, and cloud providers, including a mix of on-premises hardware and cloud infrastructure. For example, one replica could run in an office server closet, another on a Droplet in Frankfurt, and several more in AWS us-east-1, all pooled under a single URL with automatic geo-aware routing to the nearest replica. _Teams architecting multicloud and hybrid backends can track load balancing approaches like this on daily.dev._ ### How many endpoints can I add to an ngrok Endpoint Pool? On the pay-as-you-go plan, up to 1000 endpoints can be added to a single Endpoint Pool, with plans to raise that limit as the feature is optimized for more demanding workloads. This was designed partly to support use cases like distributing inference tasks across a fleet of GPUs running LLMs. _Engineers scaling GPU-backed inference workloads can keep tabs on infrastructure limits like this via daily.dev._ --- Tags: [#cloud](https://daily.dev/tags/cloud), [#devtools](https://daily.dev/tags/devtools), [#kubernetes](https://daily.dev/tags/kubernetes), [#api-gateway](https://daily.dev/tags/api-gateway) [View this post on daily.dev](https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Endpoint Pools: load balance anything, anywhere","url":"https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e"},"datePublished":"2026-08-23T07:21:17.397Z","dateModified":"2026-08-23T07:24:22.504Z","description":"ngrok has launched Endpoint Pooling, a load balancing feature that activates automatically whenever two or more endpoints share the same URL, regardless of...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/442fa2893410c5d0a6944c2d59260902?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/442fa2893410c5d0a6944c2d59260902?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"ngrok Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ngrok Blog","logo":"https://media.daily.dev/image/upload/s--718XXxvE--/f_auto,q_auto/v1787469610/logos/ngrok?_a=BAMAMicg0","url":"https://daily.dev/sources/ngrok"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"cloud,devtools,kubernetes,api-gateway","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ngrok Blog","item":"https://daily.dev/sources/ngrok"},{"@type":"ListItem","position":3,"name":"Endpoint Pools: load balance anything, anywhere"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/endpoint-pools-load-balance-anything-anywhere-5jem13a5e#faq","mainEntity":[{"@type":"Question","name":"How do I set up load balancing with ngrok?","acceptedAnswer":{"@type":"Answer","text":"Load balancing with ngrok is done by starting two or more endpoints with the same URL; ngrok automatically groups them into an Endpoint Pool and distributes traffic between them via random distribution. Endpoints must have pooling enabled, and mixing pooling-enabled and pooling-disabled endpoints on the same URL causes endpoint creation to fail. No backend list or service registry sync is required. Developers comparing zero-config load balancers to traditional gateways can follow ngrok updates on daily.dev."}},{"@type":"Question","name":"Can ngrok load balance traffic across different cloud providers or on-premises servers?","acceptedAnswer":{"@type":"Answer","text":"Yes, ngrok's Endpoint Pools balance traffic across endpoints running on different networks, regions, and cloud providers, including a mix of on-premises hardware and cloud infrastructure. For example, one replica could run in an office server closet, another on a Droplet in Frankfurt, and several more in AWS us-east-1, all pooled under a single URL with automatic geo-aware routing to the nearest replica. Teams architecting multicloud and hybrid backends can track load balancing approaches like this on daily.dev."}},{"@type":"Question","name":"How many endpoints can I add to an ngrok Endpoint Pool?","acceptedAnswer":{"@type":"Answer","text":"On the pay-as-you-go plan, up to 1000 endpoints can be added to a single Endpoint Pool, with plans to raise that limit as the feature is optimized for more demanding workloads. This was designed partly to support use cases like distributing inference tasks across a fleet of GPUs running LLMs. Engineers scaling GPU-backed inference workloads can keep tabs on infrastructure limits like this via daily.dev."}}]} ```