--- title: How to deploy an AI server on your Debian/Ubuntu server description: A step-by-step guide to setting up a local AI server on Debian or Ubuntu using Ollama and Open WebUI via Docker. Covers installing Ollama, pulling the llama3.2... canonical: https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: How to deploy an AI server on your Debian/Ubuntu server | daily.dev og:description: A step-by-step guide to setting up a local AI server on Debian or Ubuntu using Ollama and Open WebUI via Docker. Covers installing Ollama, pulling the llama3.2... og:url: https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy og:image: https://api.daily.dev/og/posts/zZuBL4bDy.png og:image:alt: How to deploy an AI server on your Debian/Ubuntu server og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # How to deploy an AI server on your Debian/Ubuntu server **[The New Stack](https://daily.dev/sources/newstack)** · 5 min read · 2 upvotes · 0 comments ## Summary A step-by-step guide to setting up a local AI server on Debian or Ubuntu using Ollama and Open WebUI via Docker. Covers installing Ollama, pulling the llama3.2 model, configuring Ollama to accept remote LAN connections via systemd, installing Docker CE, and deploying Open WebUI as a Docker container for browser-based access to local LLMs. The result is a private, self-hosted AI instance accessible from any machine on your home lab network. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [How To Deploy a Local AI via Docker](https://daily.dev/posts/how-to-deploy-a-local-ai-via-docker-brbczrhqv) · The New Stack · 0 upvotes · 0 comments - [Connect to a Local Ollama AI Instance From Within Your LAN](https://daily.dev/posts/connect-to-a-local-ollama-ai-instance-from-within-your-lan-gk4ktymdw) · The New Stack · 4 upvotes · 0 comments --- Tags: [#linux](https://daily.dev/tags/linux), [#docker](https://daily.dev/tags/docker), [#ollama](https://daily.dev/tags/ollama) [View this post on daily.dev](https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"How to deploy an AI server on your Debian/Ubuntu server","url":"https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy"},"datePublished":"2026-03-10T18:06:53.608Z","dateModified":"2026-03-10T18:07:20.945Z","description":"A step-by-step guide to setting up a local AI server on Debian or Ubuntu using Ollama and Open WebUI via Docker. Covers installing Ollama, pulling the llama3.2...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0bf5c24ffbad35dd6bebbc0951a0f813?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0bf5c24ffbad35dd6bebbc0951a0f813?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"The New Stack","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"The New Stack","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/newstack","url":"https://daily.dev/sources/newstack"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/how-to-deploy-an-ai-server-on-your-debian-ubuntu-server-zzubl4bdy","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"linux,docker,ollama","timeRequired":"PT5M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"The New Stack","item":"https://daily.dev/sources/newstack"},{"@type":"ListItem","position":3,"name":"How to deploy an AI server on your Debian/Ubuntu server"}]} ```