--- title: Building a 100% Local mini-ChatGPT | daily.dev description: A guide on building a local mini-ChatGPT app using the Llama3.2-vision model and Chainlit. The post includes a demo, necessary tools, and step-by-step coding... canonical: https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Building a 100% Local mini-ChatGPT | daily.dev og:description: A guide on building a local mini-ChatGPT app using the Llama3.2-vision model and Chainlit. The post includes a demo, necessary tools, and step-by-step coding... og:url: https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm og:image: https://api.daily.dev/og/posts/hbNMf1xCM.png og:image:alt: Building a 100% Local mini-ChatGPT og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Building a 100% Local mini-ChatGPT **[Daily Dose of Data Science \| Avi Chawla \| Substack](https://daily.dev/sources/dailydoseofds)** · 3 min read · 168 upvotes · 4 comments ## Summary A guide on building a local mini-ChatGPT app using the Llama3.2-vision model and Chainlit. The post includes a demo, necessary tools, and step-by-step coding instructions with multimodal prompting. The code and further resources for AI engineering are provided on GitHub. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Community discussion Top comments from developers on daily.dev. **@asaadsayd** · 6 upvotes > I did that with llava 7b and run it locally and connect to my router so you can go to it with your phone **@dacithethird** · 1 upvotes > Damn that’s cool af **@amanchauhan54** · 0 upvotes > currently i am also working on same, but i trained it for my personal use. BTW it's looking so good. --- Tags: [#ai](https://daily.dev/tags/ai), [#machine-learning](https://daily.dev/tags/machine-learning), [#open-source](https://daily.dev/tags/open-source), [#chatgpt](https://daily.dev/tags/chatgpt) [View this post on daily.dev](https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Building a 100% Local mini-ChatGPT","url":"https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm"},"datePublished":"2024-12-26T19:39:08.727Z","dateModified":"2024-12-26T19:39:22.654Z","description":"A guide on building a local mini-ChatGPT app using the Llama3.2-vision model and Chainlit. The post includes a demo, necessary tools, and step-by-step coding...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ef56bda5536ee8a9d27d48f6e24da306?_a=AQAEuj9","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ef56bda5536ee8a9d27d48f6e24da306?_a=AQAEuj9","isAccessibleForFree":true,"articleSection":"Daily Dose of Data Science | Avi Chawla | Substack","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Daily Dose of Data Science | Avi Chawla | Substack","logo":"https://media.daily.dev/image/upload/s--4IHQgTOw--/f_auto/v1710503712/logos/dailydoseofds","url":"https://daily.dev/sources/dailydoseofds"},"commentCount":4,"discussionUrl":"https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":168},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":4}],"keywords":"ai,machine-learning,open-source,chatgpt","timeRequired":"PT3M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Daily Dose of Data Science | Avi Chawla | Substack","item":"https://daily.dev/sources/dailydoseofds"},{"@type":"ListItem","position":3,"name":"Building a 100% Local mini-ChatGPT"}]} {"@context":"https://schema.org","@type":"WebPage","@id":"https://daily.dev/posts/building-a-100-local-mini-chatgpt-hbnmf1xcm","comment":[{"@type":"Comment","text":"I did that with llava 7b and run it locally and connect to my router so you can go to it with your phone","datePublished":"2024-12-27T15:11:09.803Z","url":"https://daily.dev/posts/hbNMf1xCM#c-OymEuVO7u","author":{"@type":"Person","name":"Asaad Sayd","url":"https://daily.dev/asaadsayd","image":"https://lh3.googleusercontent.com/a/ACg8ocJdin5ayCpgyLJigwcJ_UVnG_GAjHSts6iMyXfakkHr95LEREE=s96-c"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":6}},{"@type":"Comment","text":"Damn that’s cool af","datePublished":"2025-02-13T15:26:36.416Z","url":"https://daily.dev/posts/hbNMf1xCM#c-XXJRFGRMl","author":{"@type":"Person","name":"Daci The third","url":"https://daily.dev/dacithethird","image":"https://lh3.googleusercontent.com/a/ACg8ocJ0ThDo5QWDzquIPr4aqOb_UR8-v8zXtf9sZ3-pq3SK8J4CXqgS=s96-c"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1}},{"@type":"Comment","text":"currently i am also working on same, but i trained it for my personal use. BTW it’s looking so good.","datePublished":"2025-02-28T12:26:07.079Z","url":"https://daily.dev/posts/hbNMf1xCM#c-wkohUojn3","author":{"@type":"Person","name":"Aman Chauhan","url":"https://daily.dev/amanchauhan54","image":"https://lh3.googleusercontent.com/a/ACg8ocJYNOk1sx4gdu1NgCnZ53CZ_TZ1BPfiABH7bOjkBRp3hUrVeSA=s96-c"}}]} ```