--- title: "DwarfStar: the dwarf star illuminating local frontier AI" url: https://daily.dev/posts/dwarfstar-the-dwarf-star-illuminating-local-frontier-ai-qwk8wihpq source_url: https://www.codemotion.com/magazine/ai-ml/dwarfstar-the-dwarf-star-illuminating-local-frontier-ai type: article source: "Codemotion" published: 2026-07-14T21:49:22.778Z updated: 2026-07-23T23:56:35.722Z tags: ["data-science", "deepseek", "mixture-of-experts"] reading_time: 13 upvotes: 4 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # DwarfStar: the dwarf star illuminating local frontier AI **[Codemotion](https://daily.dev/sources/codemotion)** · 13 min read · 4 upvotes · 0 comments ## Summary DwarfStar is a new open-source inference engine written in C by Salvatore Sanfilippo (creator of Redis), designed to run the DeepSeek V4 Flash frontier model locally on consumer Apple Silicon hardware. It achieves this through aggressive asymmetric 2-bit quantization of MoE expert weights, SSD streaming for machines with insufficient RAM, persistent KV cache sessions on disk, and distributed inference across multiple machines via layer splitting. On a 128 GB M3 Max MacBook Pro, it achieves ~26 tokens/s generation with an 81 GB quantized model. The project is MIT-licensed, free, and already has 15,500 GitHub stars weeks after launch. It also explores ensemble inference combining logits from multiple model instances. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [DwarfStar — A Story](https://daily.dev/posts/dwarfstar-a-story-rzidwkopm) · Hacker News · 0 upvotes · 0 comments --- Tags: [#data-science](https://daily.dev/tags/data-science), [#deepseek](https://daily.dev/tags/deepseek), [#mixture-of-experts](https://daily.dev/tags/mixture-of-experts) [View this post on daily.dev](https://daily.dev/posts/dwarfstar-the-dwarf-star-illuminating-local-frontier-ai-qwk8wihpq)