Qwen3.8-27B-Abliterated-MLX: Uncensored Multimodal Model for Apple Silicon

LinkPocketAiHubResource

PocketAiHub has released an unofficial MLX derivative family of Qwen3.8-27B with suppressed refusal behaviour ('abliteration'). The consolidated repository provides quantized builds ranging from experimental 2-bit AWQ to full BF16 optimised for Apple Silicon.

Key points

  1. Derived from Qwen/Qwen3.8-27B by PocketAI Model Lab using the MLX framework and mlx-vlm.
  2. Includes 2-bit AWQ (experimental), 4-bit, 6-bit, 8-bit, and BF16 variants; vision towers remain in BF16.
  3. Refusal direction suppressed using harmful-minus-harmless direction projection across layers 24–63 (80 modified residual-output matrices).
  4. Tested on 100 harmful prompts with zero explicit refusals recorded across all variants.
  5. 4-bit through BF16 variants passed all 12 quality checks and 8 native tool-calling tests, whereas the 2-bit AWQ build failed tool calling and temporal video tests.
  6. Benchmarked on an Apple M5 Max with 128 GB memory, with the 4-bit build generating 33.2 tok/s.

Why it matters

For researchers and developers running local AI pipelines on macOS, this provides an accessible 27B vision-language checkpoint free from standard safety refusals. The model card explicitly warns that abliteration does not equate to improved truthfulness and requires external output validation.

Analysis

PocketAiHub provides detailed machine-readable validation and recipes for reproducibility. The benchmarks highlight the operational sweet spot: 4-bit and 6-bit variants retain full tool-calling and multimodal capabilities with manageable unified memory footprints, while extreme 2-bit quantization breaks core reasoning and tool use.

Found in

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • X post:Trevor Wood

    Qwen3.8-27B Abliterated Released for Apple Silicon via MLX

    Trevor Wood and PocketAI Model Lab have released MLX-optimised checkpoints of Qwen3.8-27B for Apple Silicon with built-in refusal mechanisms removed ('abliterated'), provided across multiple quantisation formats from 2-bit to BF16.

    3.2kbookmarks199kviews

    AI & LLMs· Announcement

  • Link:OrcaRouter

    OrcaRouter Releases Abliterated FP8 Build of Qwen3.8-27B

    OrcaRouter has released an abliterated, block-FP8 quantized version of the multimodal model Qwen3.8-27B on Hugging Face. By orthogonalising the internal refusal direction, standard safety guardrails were removed specifically for red-teaming, interpretability, and AI safety research.

    AI & LLMs· Tool

  • Link:Unsloth AI

    Unsloth Releases Qwen3.6-27B-MTP in GGUF Format

    Unsloth AI has published Qwen3.6-27B-MTP-GGUF, providing quantized versions of the first open-weight model in the Qwen3.6 family. The 27-billion parameter multimodal model features Multi-Token Prediction (MTP) for accelerated inference alongside upgrades to agentic coding and tool calling.

    AI & LLMs· Resource

  • Link:Unsloth AI

    Unsloth Releases Dynamic V3.0 GGUF Quants for Qwen3.8-27B

    Unsloth AI has published GGUF quantizations for the Qwen3.8-27B model under an Apache-2.0 licence. Utilizing their new Dynamic V3.0 quantization format, Unsloth claims over 10% higher top-1 accuracy at identical sizes compared to alternative quants. Qwen3.8-27B is a 27-billion parameter dense vision-language model featuring native text, image, and video comprehension alongside granular thinking controls.

    AI & LLMs· Tool

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.