KAT-Coder-V2.5-Dev: Open-Weight MoE Model for Coding Agents

LinkKwaipilotTool

Kwaipilot has released KAT-Coder-V2.5-Dev, an open-weight Mixture of Experts model based on Qwen3.6-35B-A3B. Featuring 35 billion total and 3 billion activated parameters, it has been specifically post-trained for agentic software engineering tasks.

Key points

  1. Architecture: MoE model with 35B total and 3B active parameters released under the Apache 2.0 licence as text-only weights without multimodal modules.
  2. Post-training pipeline: Two-phase alignment consisting of SFT on 127k samples followed by 10 epochs of Reinforcement Learning (RL).
  3. RL framework: Implements Token-in-Token-out (TITO) consistency, Truncated Importance Sampling (TIS), hierarchical rewards, and verified sandbox environments.
  4. Behaviour mitigation: Dedicated penalties counter degenerate behaviours such as runaway parallel tool calling (exceeding 70 calls per turn) and invalid tool labels.
  5. Benchmark results: Reaches 69.40% on SWE-bench Verified, 63.00% on SWE-bench Multilingual, and 41.02 on Terminal-Bench 2.1 under standardised evaluation.
  6. Inference options: Supports serving via Transformers, vLLM, SGLang, and KTransformers.

Why it matters

It offers an efficient alternative for self-hosted agentic coding workflows, keeping compute requirements low by activating only 3 billion parameters per inference step.

Analysis

The release card outlines critical failure modes in agentic RL: naive binary reward structures caused training collapse by encouraging pathological behaviour like massive parallel tool calls. Addressing these through granular execution feedback and penalty signals proved essential for multi-epoch RL stability.

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • Link:ornith-ai

    Ornith-1.5-397B: Open-Source MoE Model Focused on Coding and Reasoning

    ornith-ai has released Ornith-1.5-397B, an open-source multimodal mixture-of-experts model under the MIT licence. With 397 billion parameters and an end-to-end self-improvement loop, it delivers coding and reasoning benchmark performance comparable to top proprietary models.

    AI & LLMs· Resource

  • Link:Poolside

    Laguna-S-2.1: Open-Source MoE Model by Poolside for Agentic Coding

    Poolside has released Laguna-S-2.1, a Mixture-of-Experts language model featuring 118B total parameters with approximately 8B activated parameters per token. Targeted at software engineering and long-horizon agentic workflows, the model is available under the permissive OpenMDW-1.1 license.

    AI & LLMs· Tool

  • Article:Luis Chavez-Mattos

    Ornith 1.5 35B-A3B Benchmarks: MoE Model Outperforms Qwen3.6 in Coding and Agentic Tasks

    Deep Reinforce has introduced Ornith 1.5 35B-A3B, a mixture-of-experts model activating roughly 3 billion parameters per token out of 35 billion. According to published benchmarks, it surpasses direct competitors like Qwen3.6-35B across coding and agentic tasks, while closing the gap on much larger models such as Qwen3.5-397B.

    AI & LLMs· News

  • Link:Xiaomi MiMo Team

    Xiaomi Releases MiMo-V2.5-Pro as Open Source

    Xiaomi has unveiled MiMo-V2.5-Pro, an open-source Mixture-of-Experts model featuring 1.02 trillion total parameters with 42 billion active. The model supports a 1M-token context window and is specifically designed for complex agentic workflows and long-horizon software engineering.

    AI & LLMs· Announcement

  • Link:Moonshot AI

    Moonshot AI Releases Kimi K3: Open-Weight 2.8T MoE Model

    Moonshot AI has released Kimi K3, an open-weight native multimodal agentic model featuring 2.8 trillion total parameters and a 1-million-token context window. The architecture uses a sparse MoE setup that activates 104 billion parameters per token.

    AI & LLMs· Announcement

  • Link:deep-reinforce.com

    Ornith-1.0: Self-Scaffolding Open-Source Models for Agentic Coding

    Ornith-1.0 is an open-source model family tailored for agentic coding, spanning parameter sizes from 9B to 397B. Built on Gemma 4 and Qwen 3.5, the architecture trains models to jointly generate both code solutions and the task-specific scaffolds directing them.

    AI & LLMs· Announcement

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.