Link:Moonshot AI
Moonshot AI Releases Kimi K3: Open-Weight 2.8T MoE Model
Moonshot AI has released Kimi K3, an open-weight native multimodal agentic model featuring 2.8 trillion total parameters and a 1-million-token context window. The architecture uses a sparse MoE setup that activates 104 billion parameters per token.
From Video: How AI Models Are Built Step by Step: The Kimi K3 Case Study



