Get the app
← back to catalog · registered 2026-08-22 13:56

nuofang/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-GGUF

nuofang Qwen 9B GGUF second-order 262K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/nuofang%2FHuihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-GGUF"
Response includes
  • classification m8
  • files 6
  • hub_downloads_all_time 2,573
  • author_summary 22 models
  • readme_text full
Try next
GET/models?author=nuofang
All 22 models by nuofang
 GET/models?family=qwen&method=m8
Sibling qwen models · same method
 GET/methods/m8
What "m8" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
M1 Direct removal →
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
How we label → About M8 →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
3K
200 last 30d - cooling
Likes
0
Model age
6mo ago
created 2026-03-22
Downloads over time
Now2.7K→from1.1K↑140%
1K1.6K2.2K2.8K1.1K on Mar 252.7K on Oct 11MarAprMayJunJulAugSepOct
Mar 25 → Oct 11 · 68 snapshots · spans 200 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated↓ 220 this lineage
nuofang/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-GGUF↓ 200

Metadata

Quantizations
IQ4 Q5_K
Tags
gguf llama.cpp quantized imatrix base_model:huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated base_model:quantized:huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated endpoints_compatible region:us conversational

Related

Other by nuofang
Qwen3.8-9B-Distill-SLERP-F451-Pro-Writer-Uncensored-GGUF 15K Qwen3.8-9B-Distill-uncensored-heretic-GGUF 4K Huihui-Qwen3.5-9B-abliterated-GGUF 3K Qwen3.8-9B-abliterated-25-GGUF 2K Qwen3.5-9B-The-Bradbury-F451-Pro-Writer-Uncensored-Heretic-GGUF 993
Same base model
mradermacher/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-GGUF 4K mradermacher/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-i1-GGUF 1K mlx-community/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-4bit 287 YuYu1015/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-NVFP4 89 groxaxo/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-gptq-w4a16 43
Total size
10.9 GB
Files
6
Quantizations
4
Registered
2026-08-22 13:56
Last updated on HF
2026-03-22 05:30
Source huggingface.co/nuofang/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-GGUF ↗ Base model huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated →

Files by quantization

Q5_K 1 file 6.02 GB
Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-Q5_K_M.gguf 6.02 GB e7d2794d download
IQ4 1 file 4.84 GB
Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-IQ4_XS.gguf 4.84 GB 482a49e1 download
F16 1 file 879 MB
mmproj-Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-f16.gguf 879 MB b77ecf23 download
Auxiliary files 3 files 4.91 MB
imatrix.gguf 4.91 MB faa9c937 download
.gitattributes 1.81 KB 8d41a148 download
README.md 1.19 KB ae1d34d3 download

README current version from Hugging Face

base_model: huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated
tags:

  • llama.cpp
  • quantized
  • imatrix

Auto-Quantized GGUF Model

This repository contains automated GGUF quantization files for huihui-ai/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated.

Q5_K_M: Moderately compressed and effectively leverages the imatrix, making it nearly indistinguishable from the original precision. (recommended)
IQ4_XS: Compressed to the minimum footprint with only a slight degradation in quality.
The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.

Q5_K_M: 适度压缩且发挥了imatrix的作用，难以察觉到与原精度的区别。（推荐）
IQ4_XS: 在只有轻微质量下降的情况下，压缩到最小占用。
imatrix 的校准数据以中文的小说、角色扮演为目标，同时保留逻辑和常识。

📊 Perplexity Evaluation

(Tested against the provided calibration dataset)

  • Base (F16/BF16): PPL = 16.4336 +/- 0.14178
  • Q5_K_M: PPL = 14.6771 +/- 0.12020
  • IQ4_XS: PPL = 14.9560 +/- 0.12308

README history 6 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-22Update README.md8cdba641.2 KB
    Loading...
  2. 2026-03-22Update README.mda1941d11.3 KB
    Loading...
  3. 2026-03-22Upload README.md with huggingface_hub6bb3ac31.2 KB
    Loading...
  4. 2026-03-22Upload README.md with huggingface_hub3315dbc1.1 KB
    Loading...
  5. 2026-03-22Upload README.md with huggingface_hub1cdd49c1.1 KB
    Loading...
  6. 2026-03-22Upload README.md with huggingface_huba9c38471003 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration