Qwen3.8-27B: Alibaba's dense 27B model runs on one GPU with 262K context
Questions this post answers
What is the context window size of Qwen3.8-27B and can it be extended?
Qwen3.8-27B natively supports a 262K token context window, which can be stretched to 1M tokens using YaRN scaling. A single NVIDIA GB300 GPU has room for roughly 6.6 million KV tokens at that length, enough for about six full-length sequences running concurrently. Developers evaluating long-context models for local deployment can track releases like this on daily.dev.
Does Qwen3.8-27B support speculative decoding out of the box?
Yes, Qwen3.8-27B ships with a built-in MTP (multi-token prediction) draft head baked directly into the checkpoint, so speculative decoding works without needing a separate speculator repository. On short prompts, measured acceptance rates were 92.2% in BF16 precision and 84.8% in FP8 precision. Anyone optimizing inference latency can follow speculative decoding advances like this via daily.dev.
What software versions are required to run Qwen3.8-27B on vLLM?
Running Qwen3.8-27B requires vLLM nightly builds and transformers version 5.8.0 or later. vLLM verified the model end-to-end on NVIDIA GB300 hardware, confirming BF16 and FP8 running at tensor parallelism 4, NVFP4 at tensor parallelism 1, working tool calls, and stable generation at the full 1M context length. Teams setting up new model deployments can catch version requirements like these on daily.dev.