--- title: "Experiment with Qwen3.8-Flash-Next 176B Model on NVIDIA GB300 NVL72 for Agentic Coding" url: https://daily.dev/posts/experiment-with-qwen3-8-flash-next-176b-model-on-nvidia-gb300-nvl72-for-agentic-coding-11b0t9n11 source_url: https://developer.nvidia.com/blog/experiment-with-qwen3-8-flash-next-176b-model-on-nvidia-gb300-nvl72-for-agentic-coding type: article source: "NVIDIA Developer" published: 2026-08-26T17:10:03.189Z updated: 2026-08-26T19:58:23.148Z tags: ["ai-coding", "qwen", "mixture-of-experts"] reading_time: 3 upvotes: 2 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Experiment with Qwen3.8-Flash-Next 176B Model on NVIDIA GB300 NVL72 for Agentic Coding **[NVIDIA Developer](https://daily.dev/sources/nvidiadev)** · 3 min read · 2 upvotes · 0 comments ## Summary Alibaba released model weights for Qwen3.8-Flash-Next, a preview of the upcoming Qwen4 architecture, as a multimodal mixture-of-experts model with 176B total parameters (6B active per token) and a native 262,144-token context window extensible to 1M with YaRN. It combines Gated DeltaNet and Qwen Sparse Attention layers to cut KV cache growth and attention compute at long context lengths, delivering up to 7.6x prefill and 4.9x decoding speedups over full attention. NVIDIA provides Day 0 support via SGLang, vLLM, and TensorRT LLM, validated on GB300 NVL72, which delivers over 16K tokens/sec per GPU and 200 tokens/sec per user. The model also runs on DGX Station, DGX Spark, and RTX PRO 6000 workstations, with fine-tuning support through NeMo AutoModel and NeMo RL. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is the parameter count and architecture of Qwen3.8-Flash-Next? Qwen3.8-Flash-Next is a multimodal mixture-of-experts model with 176B total parameters, including 51B N-gram embedding parameters, activating 6B parameters per token. It uses a hybrid architecture where three out of every four layers use Gated DeltaNet to compress historical context into a fixed-size recurrent state, while the remaining layer uses Qwen Sparse Attention for precise full-context retrieval. _Track new MoE model releases like this one on daily.dev as agentic coding options evolve._ ### How much throughput does Qwen3.8-Flash-Next get on NVIDIA GB300 NVL72? Running on NVIDIA GB300 NVL72, Qwen3.8-Flash-Next delivers over 16,000 tokens per second per GPU and over 200 tokens per second per user. The GB300 NVL72 integrates 72 Blackwell Ultra GPUs with a 130 TB/s NVLink domain enabling efficient all-to-all expert traffic, supporting high-throughput, low-latency agentic coding applications. _Developers benchmarking inference hardware for agentic coding can follow results like this on daily.dev._ ### How does Qwen Sparse Attention improve long-context performance compared to full attention? Qwen Sparse Attention aggregates sequences into micro-blocks, estimates block-level importance, and selects only the most relevant regions, avoiding the growing cost of token-level indexers. Its attention kernel achieves up to 7.6x speedup during prefill and 4.9x during decoding versus full attention, and at a 1M-token context with a 90% prefix-cache hit rate, Qwen3.8-Flash-Next reached 8.6x the prefill throughput of Qwen3.7-Plus. _Engineers optimizing long-context inference can follow attention architecture advances on daily.dev._ ## Similar posts on daily.dev - [New Open Source Qwen3-Next Models Preview Hybrid MoE Architecture Delivering Improved Accuracy and Accelerated Parallel Processing across NVIDIA Platform](https://daily.dev/posts/new-open-source-qwen3-next-models-preview-hybrid-moe-architecture-delivering-improved-accuracy-and-a-rmfbqro3w) · NVIDIA Developer · 3 upvotes · 0 comments --- Tags: [#ai-coding](https://daily.dev/tags/ai-coding), [#qwen](https://daily.dev/tags/qwen), [#mixture-of-experts](https://daily.dev/tags/mixture-of-experts) [View this post on daily.dev](https://daily.dev/posts/experiment-with-qwen3-8-flash-next-176b-model-on-nvidia-gb300-nvl72-for-agentic-coding-11b0t9n11)