--- title: Best Local AI posts of 2024 | daily.dev description: The most upvoted Local AI posts of 2024, curated by the daily.dev community. canonical: https://daily.dev/tags/local-ai/best-of/2024 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/local-ai/best-of/2024 og:type: website og:site_name: daily.dev og:title: Best Local AI posts of 2024 | daily.dev og:description: The most upvoted Local AI posts of 2024, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Local AI — 2024 1. 1 [](/posts/how-to-run-an-llm-locally-with-pieces-9nya0akph "How to Run an LLM Locally with Pieces") Article Community Picks · 3y How to Run an LLM Locally with Pieces The post provides information on running Local Large Language Models (LLLMs) locally within Pieces for Developers. It discusses the demand for secure and efficient machine learning solutions, hardware requirements for running LLMs, the difference between GPU and CPU, the best GPUs for local LLMs, troubleshooting common issues, and future-proofing the setup. 41 1 2. 2 [](/posts/gemma2-tutorial-local-llm-development-with-genkit-djxultpwb "Gemma2 Tutorial: Local LLM Development with Genkit") Article Firebase Developers · 2y Gemma2 Tutorial: Local LLM Development with Genkit Google's open-source LLM, Gemma2, can be run locally using Ollama. This step-by-step guide explains how to install Gemma2, create a Genkit project, and integrate it with Ollama Gemma2\. The process involves installing appropriate packages, configuring Genkit, and writing a sample flow to handle requests. The setup is efficient enough to be accomplished in around 30 lines of code. 35 3. 3 [](/posts/run-all-your-ai-locally-in-minutes-llms-rag-and-more--e60o9dumg "Run ALL Your AI Locally in Minutes (LLMs, RAG, and more)") Video YouTube · 2y Run ALL Your AI Locally in Minutes (LLMs, RAG, and more) Learn how to set up a comprehensive local AI infrastructure using a package from the n8n team, featuring components like olama for LLMs, Quadrant for the vector database, and PostgreSQL for the SQL database. The setup process involves configuring environment variables, Docker Compose files, and integrating various tools to create a fully local RAG AI agent. The guide offers detailed steps on customizing and extending the package, troubleshooting, and future enhancement plans. 34 4. 4 [](/posts/examples-of-local-llm-usage-2vrqktygf "Examples of local LLM usage") Article Qt · 2y Examples of local LLM usage The post outlines how to use local large language models (LLMs) on a MacBook Pro M1 Max for generating images, extracting text from audio, and summarizing text. The author describes the use of stable-diffusion.cpp for image generation, whisper.cpp for audio transcription, and llama.cpp for text summarization. Detailed scripts and time performance metrics are provided for each use case. 30 5. 5 [](/posts/check-out-this-insane-ai-web-scraper-talg4st0g "Check Out This INSANE AI Web Scraper") Video Tech With Tim · 2y Check Out This INSANE AI Web Scraper An individual has built an AI web scraper that can collect property information from websites and organize it into tables without manually inspecting the site's content. The scraper uses a local LLM to parse through the DOM content and generate the desired results. A full tutorial on how to build this scraper is available. 28 1 6. 6 [](/posts/gemma-2---local-rag-with-ollama-and-langchain-mvdmlfpte "Gemma 2 - Local RAG with Ollama and LangChain") Video Sam Witteveen · 2y Gemma 2 - Local RAG with Ollama and LangChain Gemma 2 has been released for multiple formats including Keras, PyTorch, and Hugging Face transformers. This post details the author's experience using the 9B and 27B models in Ollama, highlighting the better performance of the 9B model for real-time responses. A straightforward script is provided to create a fully local Retrieval-Augmented Generation (RAG) system using Gemma 2, Nomic embeddings, and ChromaDB, all executed within VSCode. The steps involve setting up an indexer, embedding transcripts from Alex Hormozi's YouTube channel, and handling text splitting methods. Debugging tips and additional add-ons for the RAG system are also discussed. 26 1 [See all Local AI archives](/tags/local-ai/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/local-ai/best-of/2024#page","url":"https://daily.dev/tags/local-ai/best-of/2024","name":"Best Local AI Posts of 2024","description":"The most upvoted Local AI posts of 2024, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/local-ai/best-of/2024#items","numberOfItems":6,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/how-to-run-an-llm-locally-with-pieces-9nya0akph","name":"How to Run an LLM Locally with Pieces"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/gemma2-tutorial-local-llm-development-with-genkit-djxultpwb","name":"Gemma2 Tutorial: Local LLM Development with Genkit"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/run-all-your-ai-locally-in-minutes-llms-rag-and-more--e60o9dumg","name":"Run ALL Your AI Locally in Minutes (LLMs, RAG, and more)"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/examples-of-local-llm-usage-2vrqktygf","name":"Examples of local LLM usage"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/check-out-this-insane-ai-web-scraper-talg4st0g","name":"Check Out This INSANE AI Web Scraper"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/gemma-2---local-rag-with-ollama-and-langchain-mvdmlfpte","name":"Gemma 2 - Local RAG with Ollama and LangChain"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Local AI","item":"https://daily.dev/tags/local-ai"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/local-ai/best-of"},{"@type":"ListItem","position":5,"name":"2024"}]}]} ```