--- title: "Kimi K3 by Moonshot now available on Modal" url: https://daily.dev/posts/kimi-k3-by-moonshot-now-available-on-modal-hxrqajg7q source_url: https://modal.com/blog/kimi-k3-by-moonshot-now-available-on-modal type: article source: "Modal" published: 2026-07-27T15:26:44.804Z updated: 2026-07-28T04:17:27.404Z tags: ["llm", "ai-inference", "vllm", "mixture-of-experts", "kimi-k3"] reading_time: 4 upvotes: 9 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Kimi K3 by Moonshot now available on Modal **[Modal](https://daily.dev/sources/modal_labs)** · 4 min read · 9 upvotes · 0 comments ## Summary Moonshot's Kimi K3, a 2.8 trillion parameter mixture-of-experts multimodal model with a 1M token context window and native vision, is now available on Modal. It ranks as the strongest open model on Artificial Analysis's Intelligence Index, fourth overall among 186 models. Modal partnered with Moonshot and vLLM for day-zero support, offering it via a Shared API with token-based pricing and as a dedicated Auto Endpoint. Modal also trained a custom DFlash speculator tuned to K3's architecture, boosting decode throughput from ~50 tokens/sec to over 100 tokens/sec per GPU, with per-user ceilings above 200 tokens/sec. Key architectural innovations include Kimi Delta Attention for efficient long-context handling and Attention Residuals for improved scaling efficiency. The model uses MXFP4 weights and MXFP8 activations from quantization-aware training, enabling broad hardware compatibility. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#llm](https://daily.dev/tags/llm), [#ai-inference](https://daily.dev/tags/ai-inference), [#vllm](https://daily.dev/tags/vllm), [#mixture-of-experts](https://daily.dev/tags/mixture-of-experts), [#kimi-k3](https://daily.dev/tags/kimi-k3) [View this post on daily.dev](https://daily.dev/posts/kimi-k3-by-moonshot-now-available-on-modal-hxrqajg7q)