← back to catalog · registered 2026-08-22 13:56

mradermacher/Huihui-Qwen3-14B-abliterated-v2-GGUF

mradermacher Qwen 14B GGUF second-order 41K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/mradermacher%2FHuihui-Qwen3-14B-abliterated-v2-GGUF"
Response includes
  • classification m8
  • files 13
  • hub_downloads_all_time 39,790
  • author_summary 3324 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of layer-wise ablation inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 3 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=mradermacher (M8 quantization producer, never originator)
  • is_gguf=1
  • base_model='huihui-ai/Huihui-Qwen3-14B-abliterated-v2' (base is huihui-ai model (M3))
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
40K
Likes
11
Model age
16mo ago
created 2025-06-17
Downloads over time
Now74.7K→from833↑8,869%
027.4K54.7K82.1K833 on Jun 28, 202574.7K on Oct 11Jun '25Sep '25Dec '25MarJunSep
Jun 28, 2025 → Oct 11 · 107 snapshots · spans 470 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 54K downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
apache-2.0
Languages
en
Quantizations
IQ4 Q2_K Q3_K Q4_K Q5_K Q6_K Q8_0
Tags
transformers gguf chat abliterated uncensored en base_model:huihui-ai/Huihui-Qwen3-14B-abliterated-v2 base_model:quantized:huihui-ai/Huihui-Qwen3-14B-abliterated-v2 license:apache-2.0 endpoints_compatible region:us

Related

Total size
95.0 GB
Files
13
Quantizations
8
Registered
2026-08-22 13:56
Last updated on HF
2025-07-11 00:48

Files by quantization

Q8_0 1 file 14.6 GB
Huihui-Qwen3-14B-abliterated-v2.Q8_0.gguf 14.6 GB 2b83cab4 download
Q6_K 1 file 11.3 GB
Huihui-Qwen3-14B-abliterated-v2.Q6_K.gguf 11.3 GB 689193a7 download
Q5_K 2 files 19.4 GB
Huihui-Qwen3-14B-abliterated-v2.Q5_K_M.gguf 9.79 GB 178bf138 download
Huihui-Qwen3-14B-abliterated-v2.Q5_K_S.gguf 9.56 GB b7236803 download
Q4_K 2 files 16.4 GB
Huihui-Qwen3-14B-abliterated-v2.Q4_K_M.gguf 8.38 GB 66effa78 download
Huihui-Qwen3-14B-abliterated-v2.Q4_K_S.gguf 7.98 GB c7b79313 download
IQ4 1 file 7.62 GB
Huihui-Qwen3-14B-abliterated-v2.IQ4_XS.gguf 7.62 GB c9c29d65 download
Q3_K 3 files 20.4 GB
Huihui-Qwen3-14B-abliterated-v2.Q3_K_L.gguf 7.36 GB 43c57970 download
Huihui-Qwen3-14B-abliterated-v2.Q3_K_M.gguf 6.82 GB 1001185f download
Huihui-Qwen3-14B-abliterated-v2.Q3_K_S.gguf 6.20 GB 9a42979d download
Q2_K 1 file 5.36 GB
Huihui-Qwen3-14B-abliterated-v2.Q2_K.gguf 5.36 GB 02292acc download
Auxiliary files 2 files 7.31 KB
README.md 4.98 KB 155fa971 download
.gitattributes 2.34 KB c0bcd972 download

README current version from Hugging Face


base_model: huihui-ai/Huihui-Qwen3-14B-abliterated-v2
extra_gated_prompt: |-
Usage Warnings

“Risk of Sensitive or Controversial Outputs“: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.
“Not Suitable for All Audiences:“ Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.
“Legal and Ethical Responsibilities“: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.
“Research and Experimental Use“: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.
“Monitoring and Review Recommendations“: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.
“No Default Safety Guarantees“: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.
language:


About

static quants of https://huggingface.co/huihui-ai/Huihui-Qwen3-14B-abliterated-v2

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants are available at https://huggingface.co/mradermacher/Huihui-Qwen3-14B-abliterated-v2-i1-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's
READMEs
for
more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
GGUF Q2_K 5.9
GGUF Q3_K_S 6.8
GGUF Q3_K_M 7.4 lower quality
GGUF Q3_K_L 8.0
GGUF IQ4_XS 8.3
GGUF Q4_K_S 8.7 fast, recommended
GGUF Q4_K_M 9.1 fast, recommended
GGUF Q5_K_S 10.4
GGUF Q5_K_M 10.6
GGUF Q6_K 12.2 very good quality
GGUF Q8_0 15.8 fast, best quality

Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

image.png

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.

README history 5 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-07-11auto-patch README.mddaac9775 KB
    Loading...
  2. 2025-07-10auto-patch README.md56747314.9 KB
    Loading...
  3. 2025-06-18auto-patch README.md8fae8e64.8 KB
    Loading...
  4. 2025-06-17auto-patch README.mda6af5bb3.4 KB
    Loading...
  5. 2025-06-17uploaded from rich1761f5ee231 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration