OrcaRouter Releases Abliterated FP8 Build of Qwen3.8-27B

LinkOrcaRouterTool

OrcaRouter has released an abliterated, block-FP8 quantized version of the multimodal model Qwen3.8-27B on Hugging Face. By orthogonalising the internal refusal direction, standard safety guardrails were removed specifically for red-teaming, interpretability, and AI safety research.

Key points

  1. Based on Qwen/Qwen3.8-27B, featuring a hybrid Gated DeltaNet architecture, a 262,144-token context window, and native vision capabilities.
  2. Abliteration follows Arditi et al. (2024), removing the single refusal direction from 131 residual-writing matrices.
  3. Implements offline 128×128 block-FP8 (E4M3) quantization identical to the official Qwen FP8 build.
  4. Maintains the MTP speculative decoding head and leaves the vision-language tower unedited.
  5. Refusal rates drop from 64–99% on the base FP8 model to 0–6% across AdvBench, StrongREJECT, and HarmBench.
  6. Released under the Apache 2.0 license strictly for safety research, red-teaming, and controlled evaluation.

Why it matters

This release highlights the viability of abliteration techniques on models combining linear hybrid attention, multimodal processing, and speculative decoding heads within an FP8 footprint. While highly useful for stress-testing and automated red-teaming, it underscores how post-training refusal mechanisms in open-weight models can be systematically bypassed.

Analysis

The release demonstrates the precision of representation engineering on recent architectures. By isolating and orthogonalising the refusal vector in float32 before re-quantizing down to block-FP8, base multimodal performance and inference efficiency in engines like vLLM and SGLang remain intact. The authors emphasise strict disclaimers, noting that the model must not be served directly to end-users without external safety and moderation layers.

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • Link:PocketAiHub

    Qwen3.8-27B-Abliterated-MLX: Uncensored Multimodal Model for Apple Silicon

    PocketAiHub has released an unofficial MLX derivative family of Qwen3.8-27B with suppressed refusal behaviour ('abliteration'). The consolidated repository provides quantized builds ranging from experimental 2-bit AWQ to full BF16 optimised for Apple Silicon.

    AI & LLMs· Resource

  • X post:Samuel Cardillo

    OrcaRouter Releases Uncensored Weights for Qwen3.8 27B FP8

    Samuel Cardillo highlights OrcaRouter's release of uncensored weights for Qwen3.8 27B FP8, suggesting Anthropic will be furious. According to OrcaRouter, the weights are designed specifically for AI red teaming and security research.

    604bookmarks227.9kviews

    AI & LLMs· Opinion

  • X post:Trevor Wood

    Qwen3.8-27B Abliterated Released for Apple Silicon via MLX

    Trevor Wood and PocketAI Model Lab have released MLX-optimised checkpoints of Qwen3.8-27B for Apple Silicon with built-in refusal mechanisms removed ('abliterated'), provided across multiple quantisation formats from 2-bit to BF16.

    3.2kbookmarks199kviews

    AI & LLMs· Announcement

  • Link:Unsloth AI

    Unsloth Releases Dynamic V3.0 GGUF Quants for Qwen3.8-27B

    Unsloth AI has published GGUF quantizations for the Qwen3.8-27B model under an Apache-2.0 licence. Utilizing their new Dynamic V3.0 quantization format, Unsloth claims over 10% higher top-1 accuracy at identical sizes compared to alternative quants. Qwen3.8-27B is a 27-billion parameter dense vision-language model featuring native text, image, and video comprehension alongside granular thinking controls.

    AI & LLMs· Tool

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.