FrontierAugust 26, 2026via MarkTechPost
Alibaba’s Qwen Team Releases Qwen3.8-Flash-Next: A 125B Multimodal MoE With 6B Active Parameters Previewing the Qwen4 Architecture
Why it matters
Open-weight model release with novel MoE and attention architecture, significant training efficiency gains, and concrete multimodal capabilities. This is Alibaba signaling architectural parity with frontier labs while competing on efficiency — practitioners need to benchmark this against Claude/GPT equivalents.
Key signals
- 125B backbone + 51B N-gram embedding + 4B multi-token prediction = 180B total parameters
- 6B active parameters per token
- 1/9 training cost vs. Qwen3.7-Plus
- 172.78 GiB FP8 checkpoint size (self-hosting requirement)
- Four architectural innovations: Gated DeltaNet + Qwen Sparse Attention hybrid, Gated Residual, N-gram Embedding, Muon optimizer
- Multimodal capability confirmed
- Open-weight release (benchmark results mentioned but specific scores not extracted)
The hook
Alibaba's Qwen3.8-Flash-Next: 125B multimodal MoE, 6B active params, 1/9 the training cost of Qwen3.7-Plus. The Qwen4 architecture preview is here.
We look at Qwen3.8-Flash-Next, Alibaba's open-weight multimodal Mixture-of-Experts model and an early preview of the Qwen4 architecture. We break down where the 180B parameters actually sit: a 125B backbone, a 51B N-gram embedding table, and a 4B multi-token prediction module, with only 6B active pe…