--- title: AI meets privacy: ngrok's secure bridge to customer data description: A walkthrough of deploying AI workloads directly into a customer's virtual private cloud using a Bring Your Own Cloud (BYOC) architecture, with ngrok acting as... canonical: https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: AI meets privacy: ngrok's secure bridge to customer data | daily.dev og:description: A walkthrough of deploying AI workloads directly into a customer's virtual private cloud using a Bring Your Own Cloud (BYOC) architecture, with ngrok acting as... og:url: https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9 og:image: https://api.daily.dev/og/posts/yOljDkIJ9.png og:image:alt: AI meets privacy: ngrok's secure bridge to customer data og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # AI meets privacy: ngrok's secure bridge to customer data **[ngrok Blog](https://daily.dev/sources/ngrok)** · 11 min read · 0 upvotes · 0 comments ## Summary A walkthrough of deploying AI workloads directly into a customer's virtual private cloud using a Bring Your Own Cloud (BYOC) architecture, with ngrok acting as a secure tunneling layer between a SaaS control plane and the customer's data plane. Covers setting up ngrok's Kubernetes Ingress Controller, custom wildcard domains, authtoken scoping, IP restrictions, and route fanout, using a containerized Ollama service as an illustrative (non-production) example of exposing AI APIs without moving customer data out of their infrastructure. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is a Bring Your Own Cloud (BYOC) architecture in the context of AI SaaS products? BYOC architecture means deploying your service into a customer's own cloud data plane to process their data locally, while your SaaS platform acts as the control plane coordinating what gets analyzed and displaying results. This avoids egressing sensitive customer data out of their infrastructure, reduces compliance risk, and shifts most compute costs onto the customer's own cloud resources. Databricks is a well-known example of a platform using this model. _daily.dev surfaces architecture patterns like BYOC for teams designing customer-data-sensitive AI products._ ### How can I expose a Kubernetes service running in a customer's VPC securely without opening inbound firewall ports? Install the ngrok Kubernetes Ingress Controller via Helm on the customer's cluster and configure it with a customer-specific ngrok Authtoken scoped to a wildcard domain. Ngrok's agent creates an outbound-only secure tunnel to ngrok's Cloud Edge, automatically provisioning HTTPS edges for your routes, so no inbound firewall changes or lengthy NetOps approvals are required. _developers wiring up secure cross-network tunnels can track ngrok workflow guides on daily.dev._ ### Why shouldn't customer data be uploaded to a vendor's own cloud for AI processing instead of using BYOC? Customers typically refuse to egress their data due to regulatory and governance obligations, and the transfer costs of moving large datasets between clouds can outweigh the value the AI service provides. Running the AI workload inside the customer's own VPC instead avoids both the compliance risk and the data-transfer expense, while still letting the vendor's control plane orchestrate and view results remotely. _teams weighing data residency trade-offs in AI product design can find related architecture writeups on daily.dev._ ## Similar posts on daily.dev - [Cloud-Native Architecture’s Next Test: Holding Up Under Agentic AI](https://daily.dev/posts/cloud-native-architecture-s-next-test-holding-up-under-agentic-ai-kfcwub7yg) · Cloud Native Now · 0 upvotes · 0 comments - [KubeCon NA 2025 - Erica Hughberg and Alexa Griffith on Tools for the Age of GenAI](https://daily.dev/posts/kubecon-na-2025---erica-hughberg-and-alexa-griffith-on-tools-for-the-age-of-genai-pavyctafs) · InfoQ · 0 upvotes · 0 comments --- Tags: [#devtools](https://daily.dev/tags/devtools), [#kubernetes](https://daily.dev/tags/kubernetes), [#data-privacy](https://daily.dev/tags/data-privacy), [#ollama](https://daily.dev/tags/ollama) [View this post on daily.dev](https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"AI meets privacy: ngrok's secure bridge to customer data","url":"https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9"},"datePublished":"2026-08-23T07:21:29.743Z","dateModified":"2026-08-23T07:29:04.232Z","description":"A walkthrough of deploying AI workloads directly into a customer's virtual private cloud using a Bring Your Own Cloud (BYOC) architecture, with ngrok acting as...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ce41983765e7935a9ff5d2a10c9afade?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ce41983765e7935a9ff5d2a10c9afade?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"ngrok Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ngrok Blog","logo":"https://media.daily.dev/image/upload/s--718XXxvE--/f_auto,q_auto/v1787469610/logos/ngrok?_a=BAMAMicg0","url":"https://daily.dev/sources/ngrok"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devtools,kubernetes,data-privacy,ollama","timeRequired":"PT11M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ngrok Blog","item":"https://daily.dev/sources/ngrok"},{"@type":"ListItem","position":3,"name":"AI meets privacy: ngrok's secure bridge to customer data"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/ai-meets-privacy-ngrok-s-secure-bridge-to-customer-data-yoljdkij9#faq","mainEntity":[{"@type":"Question","name":"What is a Bring Your Own Cloud (BYOC) architecture in the context of AI SaaS products?","acceptedAnswer":{"@type":"Answer","text":"BYOC architecture means deploying your service into a customer's own cloud data plane to process their data locally, while your SaaS platform acts as the control plane coordinating what gets analyzed and displaying results. This avoids egressing sensitive customer data out of their infrastructure, reduces compliance risk, and shifts most compute costs onto the customer's own cloud resources. Databricks is a well-known example of a platform using this model. daily.dev surfaces architecture patterns like BYOC for teams designing customer-data-sensitive AI products."}},{"@type":"Question","name":"How can I expose a Kubernetes service running in a customer's VPC securely without opening inbound firewall ports?","acceptedAnswer":{"@type":"Answer","text":"Install the ngrok Kubernetes Ingress Controller via Helm on the customer's cluster and configure it with a customer-specific ngrok Authtoken scoped to a wildcard domain. Ngrok's agent creates an outbound-only secure tunnel to ngrok's Cloud Edge, automatically provisioning HTTPS edges for your routes, so no inbound firewall changes or lengthy NetOps approvals are required. developers wiring up secure cross-network tunnels can track ngrok workflow guides on daily.dev."}},{"@type":"Question","name":"Why shouldn't customer data be uploaded to a vendor's own cloud for AI processing instead of using BYOC?","acceptedAnswer":{"@type":"Answer","text":"Customers typically refuse to egress their data due to regulatory and governance obligations, and the transfer costs of moving large datasets between clouds can outweigh the value the AI service provides. Running the AI workload inside the customer's own VPC instead avoids both the compliance risk and the data-transfer expense, while still letting the vendor's control plane orchestrate and view results remotely. teams weighing data residency trade-offs in AI product design can find related architecture writeups on daily.dev."}}]} ```