Thinking Machines Lab Releases Inkling-Small

ArticleThinking Machines LabAnnouncement

Thinking Machines Lab has introduced Inkling-Small, an open-weights Mixture-of-Experts model (276B total, 12B active parameters) designed to deliver performance comparable to Inkling at a fraction of its size and compute cost.

Key points

  1. Mixture-of-Experts transformer with 276B total and 12B active parameters, trained on NVIDIA GB300 NVL72 clusters.
  2. Native encoder-free multimodal support for audio and visual reasoning alongside text, offering up to a 1M token context window.
  3. Matches or exceeds Inkling on reasoning and agentic tasks, scoring 31.6% on Humanity's Last Exam and 80.2% on SWEBench-Verified.
  4. Features adjustable thinking effort to balance cost and performance, with output pricing at $1.20 per 1M tokens.
  5. The larger 975B Inkling retains a distinct advantage in broad knowledge coverage and factuality.

Why it matters

Inkling-Small demonstrates how post-training distillation and specialized agentic reinforcement learning can make smaller open-weights models outperform much larger systems in software engineering and reasoning at significantly lower inference costs.

Analysis

By deploying on-policy distillation from the 975B parameter Inkling and extending agentic coding RL, Thinking Machines Lab built a highly efficient generalist model. Benchmarks such as Terminal-Bench 2.1 and SWEBench-Verified highlight strong execution on agentic workflows relative to its compute footprint. However, the drop in factuality on benchmarks like SimpleQA confirms that parameter reduction primarily impacts memorized knowledge rather than logical and tool-based problem-solving capabilities.

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • Article:Thinking Machines Lab

    Thinking Machines Lab Releases Open-Weights Model Inkling

    Thinking Machines Lab has introduced Inkling, an open-weights Mixture-of-Experts model featuring 975B total parameters (41B active) and a 1M token context window. It is built as a generalist foundation optimized for customization via the Tinker platform.

    AI & LLMs· Announcement

  • Link:inclusionAI

    Ling-3.0-tiny: Lightweight Hybrid Reasoning MoE Model by inclusionAI

    inclusionAI has introduced Ling-3.0-tiny, a compact MoE model with 7.9B total parameters activating only 1.3B parameters per token. Utilizing a hybrid architecture of linear and latent attention mechanisms, it aims to deliver efficient reasoning and agentic workloads on local hardware.

    AI & LLMs· Tool

  • Repository:inclusionAI/Ling

    Ling: Open-Source Mixture-of-Experts LLMs by InclusionAI

    InclusionAI has open-sourced Ling, a family of Mixture-of-Experts (MoE) large language models. The suite is offered in two sizes: Ling-lite with 16.8 billion total parameters (2.75 billion activated) and Ling-plus with 290 billion total parameters (28.8 billion activated).

    267starsPython

    AI & LLMs· Resource

  • Link:ornith-ai

    Ornith-1.5-397B: Open-Source MoE Model Focused on Coding and Reasoning

    ornith-ai has released Ornith-1.5-397B, an open-source multimodal mixture-of-experts model under the MIT licence. With 397 billion parameters and an end-to-end self-improvement loop, it delivers coding and reasoning benchmark performance comparable to top proprietary models.

    AI & LLMs· Resource

  • Article:Zhidx

    Ant Group open-sources compact MoE model Ling-3.0-tiny

    Ant Group's Bailian team has released Ling-3.0-tiny, an open-source lightweight mixture-of-experts model. It leverages DeepSeek's MLA and Kimi's KDA architectures with 7.9B total parameters, activating just 1.3B parameters per token for local edge deployment on hardware like Apple Silicon Macs and DGX systems.

    AI & LLMs· Announcement

  • Article:Chris Alexiuk and Chintan Patel

    NVIDIA Nemotron 3.5 Lightning: Compact MoE Model for Agentic Execution

    NVIDIA has announced Nemotron 3.5 Lightning, an open 30B mixture-of-experts (MoE) model featuring 3B active parameters. It is tailored for the high-volume execution layer of long-running AI agents, targeting routine tasks such as tool calling and result validation with low latency.

    AI & LLMs· Announcement

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.