Laya: Non-Autoregressive System 1 Decision Model for Classification and Routing

LinkconvaiinnovationsTool

Convai Innovations released Laya, a lightweight decision model designed for structured classification and routing across 100+ languages. Instead of generating text, it outputs typed answers and calibrated probabilities in a single forward pass.

Key points

  1. Non-autoregressive architecture eliminates hallucinations and JSON parsing issues by avoiding free-form text generation.
  2. Includes three checkpoints: ModernBERT-large (421M) for English, mmBERT-base (322M, supporting up to 8,192 tokens) for multilingual text, and a workflow-specialised variant.
  3. Built-in Router detects script and language in sub-milliseconds to dispatch requests to the optimal checkpoint.
  4. Trained using reinforcement learning with strictly proper scoring rules (RLCD) to ensure honest, calibrated probability scores.
  5. Inference completes in around 33 ms on GPU; includes ecosystem support for LangChain, MCP, HTTP serving, and ONNX Runtime.

Why it matters

Generative LLMs are often overly expensive, slow, and prone to formatting errors when used solely for triage, guardrails, or routing. Laya offers an efficient, deterministic alternative tailored for high-throughput pipeline decisions.

Analysis

By focusing strictly on classification and scoring via encoder backbones (ModernBERT and mmBERT), Laya targets the 'System 1' operational layer of AI workflows. Its use of RLCD for confidence calibration makes it suitable for automated fallback and gating systems. The hybrid router approach effectively balances latency and accuracy between language-specific and multilingual weights without requiring complex custom pipeline code.

Found in

Summary generated by AI (Gemini 3.8 Flash, 29 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.