--- title: "Running local models is good now" url: https://daily.dev/posts/running-local-models-is-good-now-q20vqhe78 source_url: https://vickiboykis.com/2026/06/15/running-local-models-is-good-now type: article source: "Lobsters" published: 2026-06-17T07:08:41.119Z updated: 2026-06-18T02:15:07.872Z tags: ["ai-coding", "gemma", "llama-cpp", "lm-studio"] reading_time: 7 upvotes: 1 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Running local models is good now **[Lobsters](https://daily.dev/sources/lobsters)** · 7 min read · 1 upvotes · 0 comments ## Summary Local LLMs have matured significantly, with models like Gemma 4 and GPT-OSS now capable of agentic coding tasks at roughly 75% the accuracy of frontier models. The author shares a practical setup using LM Studio as the inference server and Pi as the agent harness, running inside a Docker container for security. The post covers model choices (Gemma 4 26B/12B QAT, Qwen 3 MOE), tooling options (Ollama, llama.cpp, LM Studio), and real-world tasks like Python refactoring, unit test generation, and bootstrapping recommendation system repos. Limitations remain — slow inference, small context windows, and prompt template mismatches — but the ecosystem is improving rapidly. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Running Pi with local LLMs on a Raspberry Pi sounds chaotic, but it actually works](https://daily.dev/posts/running-pi-with-local-llms-on-a-raspberry-pi-sounds-chaotic-but-it-actually-works-y6ekdzsbh) · XDA Developers · 1 upvotes · 0 comments - [Running local models on an M4 with 24GB memory](https://daily.dev/posts/running-local-models-on-an-m4-with-24gb-memory-iezpeho6j) · Hacker News · 4 upvotes · 0 comments --- Tags: [#ai-coding](https://daily.dev/tags/ai-coding), [#gemma](https://daily.dev/tags/gemma), [#llama-cpp](https://daily.dev/tags/llama-cpp), [#lm-studio](https://daily.dev/tags/lm-studio) [View this post on daily.dev](https://daily.dev/posts/running-local-models-is-good-now-q20vqhe78)