FrontierThe story, in brief
Moonshot AI Releases Kimi K3: A 2.8 Trillion Parameter Open MoE Model With Kimi Delta Attention and 1M Context
2.8 trillion parameters. Moonshot AI just open-sourced Kimi K3 with 1M context and a novel attention mechanism that could reshape the MoE landscape.
The KeyNews take
Why it matters
Moonshot AI's Kimi K3 represents a significant capability jump in open-source MoE architectures, combining massive scale (2.8T params), extended context (1M tokens), and novel attention innovations. This directly challenges closed-model incumbents and signals China's AI research leadership in efficiency-first design.
The key facts
7 to know2.8 trillion parameters
Mixture of Experts: 16 of 896 experts activated
1M token context window
Novel architecture: Kimi Delta Attention + Attention Residuals
Open-source release
Published July 16, 2026
Moonshot AI (Chinese lab)
Go to the source
MarkTechPostmarktechpost.com
Publisher excerpt: Moonshot AI released Kimi K3 on July 16, 2026. It is a 2.8-trillion-parameter open MoE model built on Kimi Delta Attention and Attention Residuals, activating 16 of 896 experts.