Xiaomi Releases MiMo-V2.5-Pro as Open Source

LinkXiaomi MiMo TeamAnnouncement

Xiaomi has unveiled MiMo-V2.5-Pro, an open-source Mixture-of-Experts model featuring 1.02 trillion total parameters with 42 billion active. The model supports a 1M-token context window and is specifically designed for complex agentic workflows and long-horizon software engineering.

Key points

  1. MoE architecture featuring 1.02T total parameters, 42B active parameters, and a 1M context window, released under a permissive licence on Hugging Face.
  2. Hybrid attention pairs Local Sliding Window (128 tokens) with Global Attention at a 6:1 ratio, cutting KV-cache memory requirements by nearly 7x.
  3. Integrated Multi-Token Prediction (MTP) roughly triples output throughput during training and inference.
  4. Demonstrates sustained autonomy over long horizons, building a full SysY compiler in Rust (672 tool calls, 233/233 tests passed) and an 8,192-line desktop video editor (1,868 tool calls).
  5. Successfully optimised an analog FVF-LDO circuit design in TSMC 180nm CMOS via an automated ngspice loop driven by Claude Code.
  6. Reaches comparable frontier-level benchmark scores while using 40-60% fewer tokens per trajectory on ClawEval than models like Claude Opus 4.6, Gemini 3.1 Pro, and GPT-5.4.

Why it matters

Open-source frontier models continue to narrow the gap with proprietary industry leaders. MiMo-V2.5-Pro demonstrates that algorithmic efficiency, such as hybrid attention and multi-token prediction, allows models to maintain coherent multi-hour agent trajectories and deliver complex software engineering outputs without exponential token overhead.

Analysis

Xiaomi focuses heavily on long-horizon coherence and token economics. By combining Sliding Window Attention with Global Attention, the architecture significantly reduces the KV-cache footprint across long contexts. The three-stage post-training regimen leverages domain-specific reinforcement learning teachers unified through Multi-Teacher On-Policy Distillation (MOPD). As demonstrated by its integration into agent frameworks like Claude Code, MiMo-V2.5-Pro provides a viable high-performance open-weights option for iterative, tool-heavy engineering tasks.

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • Link:Moonshot AI

    Moonshot AI Releases Kimi K3: Open-Weight 2.8T MoE Model

    Moonshot AI has released Kimi K3, an open-weight native multimodal agentic model featuring 2.8 trillion total parameters and a 1-million-token context window. The architecture uses a sparse MoE setup that activates 104 billion parameters per token.

    AI & LLMs· Announcement

  • Link:Tencent Hy Team

    Tencent Releases Hy4-preview MoE Model Under Apache 2.0 License

    The Tencent Hy Team has released Hy4-preview, an open-source Mixture-of-Experts (MoE) model featuring 770B total parameters and 49B activated parameters per token. The flagship model supports a 1M token context window and is tuned for software engineering, office analytics, and scientific research.

    AI & LLMs· Announcement

  • Link:Z.ai

    Z.ai Releases GLM-5.2 with 1M Context Window and MIT Licence

    Z.ai has released GLM-5.2 on Hugging Face under the permissive MIT licence. The flagship open-weights model is designed for long-horizon agentic and coding workflows, featuring a robust 1M-token context window. Architectural updates including IndexShare and an enhanced MTP layer significantly cut computation FLOPs and accelerate speculative decoding.

    AI & LLMs· Resource

  • Link:ornith-ai

    Ornith-1.5-397B: Open-Source MoE Model Focused on Coding and Reasoning

    ornith-ai has released Ornith-1.5-397B, an open-source multimodal mixture-of-experts model under the MIT licence. With 397 billion parameters and an end-to-end self-improvement loop, it delivers coding and reasoning benchmark performance comparable to top proprietary models.

    AI & LLMs· Resource

  • Link:Apodex AI

    Apodex-1.1-mini: Multimodal Agentic Model Released on Hugging Face

    Apodex AI has released Apodex-1.1-mini under the Apache-2.0 licence on Hugging Face. Based on the qwen3_5_moe architecture, the model is designed for long-horizon research and agentic workflows with native tool execution.

    AI & LLMs· Tool

  • Article:DeepSeek AI

    DeepSeek Launches DeepSeek-V4 Preview as Open Source with 1M Context

    DeepSeek has open-sourced the preview release of DeepSeek-V4. The line-up features DeepSeek-V4-Pro and DeepSeek-V4-Flash, standardising a 1M context window and introducing architectural innovations to cut compute and memory overhead.

    AI & LLMs· Announcement

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.