← back to catalog · registered 2026-11-19 05:04

catonooka/Qwen3.8-27B-Heretic-Abliterated-EXL3-4.0bpw-h8

catonooka Qwen 27B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/catonooka%2FQwen3.8-27B-Heretic-Abliterated-EXL3-4.0bpw-h8"
Response includes
  • classification m3
  • files 17
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · 30-day
21
Likes
0
Model age
3d ago
created 2026-11-19
Downloads over time
Now 21 → from 0 ↑ 0%
081523 0 on Nov 19 21 on Nov 22 Nov
Nov 19 → Nov 22 · 4 snapshots · spans 3 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Tags
exllamav3 safetensors qwen3_5 exl3 abliterated uncensored qwen3.8 quantized base_model:Qwen/Qwen3.8-27B base_model:quantized:Qwen/Qwen3.8-27B license:other 4-bit

Related

Control vectors

Total size
15.7 GB
Files
17
Quantizations
1
Registered
2026-11-19 05:04
Last updated on HF
2026-11-19 04:49

Files by quantization

Auxiliary files 17 files 15.7 GB
model-00001-of-00002.safetensors 7.89 GB ace926df download
model-00002-of-00002.safetensors 7.78 GB 43af5fcd download
tokenizer.json 19.1 MB a5cd9732 download
vocab.json 6.41 MB 0aa0ce06 download
merges.txt 3.20 MB a494e019 download
quantization_config.json 614 KB 79ab1dab download
model.safetensors.index.json 289 KB ef42aeca download
LICENSE 11.3 KB f938136e download
chat_template.jinja 8.79 KB 9bd39df8 download
config.json 4.66 KB 2140937b download
tokenizer_config.json 2.47 KB 4cd034e8 download
README.md 1.75 KB 0996a93b download
.gitattributes 1.53 KB 52373fe2 download
processor_config.json 1.19 KB 43c4343e download
preprocessor_config.json 390 B 2ea84a43 download
video_preprocessor_config.json 385 B 3ba673a5 download
generation_config.json 214 B a4b665dd download

README current version from Hugging Face


license: other
license_name: qwen-community
license_link: LICENSE
base_model:

  • Qwen/Qwen3.8-27B
  • catonooka/Qwen3.8-27B-Heretic-Abliterated
    library_name: exllamav3
    tags:
  • exl3
  • abliterated
  • uncensored
  • qwen3.8
  • quantized

Qwen3.8-27B-Heretic-Abliterated-EXL3-4.0bpw-h8

EXL3 quantization (4.0 bpw, head_bits 8) of
catonooka/Qwen3.8-27B-Heretic-Abliterated
(bf16 source). See that card for the abliteration method, trial parameters and evals.

Quant recipe

  • exllamav3 converter, bits 4.0, head_bits 8, embed_bits 16, codebook mul1
  • mtp_bits 4 (MTP head quantized in-pack for speculative decode), vision_bits 0 (vision
    tower dropped in this pack; use the bf16 repo if you need vision)
  • cal 250 rows x 2048 cols, hessians_reg 0.025, shard 8192
  • Wall clock on 4x RTX 3090: 42 min, 672 modules

Speculative decode acceptance (DSpine 5-layer drafter, EXL3 5.0bpw-h8, pretrained on STOCK)

Same drafter that serves the stock model, no retraining:

config accept t/s
story think ndt7 26.0% (stock pack baseline: 19.2%) 57.9
code think ndt7 73.0% 121.6
code think ndt15 47.7% 155.2

Abliteration did not hurt draft acceptance; the gate to retrain the drafter never triggered.

Thinking levels (same prompt, temp 0)

All four template levels work on this build: xhigh 383 think-words, medium 79, low 57,
off 0 (no leakage, clean prose). Control thinking ONLY via chat-template kwargs
(enable_thinking: false, reasoning_effort: xhigh|medium|low). Hard-banning the
<think> token in a raw prompt makes this build stop instantly.

Loader

exllamav3 (Config.from_directory). Standard EXL3 pack layout with tokenizer and
quantization_config included.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-19 Upload folder using huggingface_hub 03e8851 1.8 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration