← back to catalog · registered 2026-08-22 13:56

mradermacher/huihui-ai_Qwen3-30B-A3B-abliterated-clone-GGUF

mradermacher Qwen 30B GGUF MoE second-order 41K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/mradermacher%2Fhuihui-ai_Qwen3-30B-A3B-abliterated-clone-GGUF"
Response includes
  • classification m8
  • files 13
  • hub_downloads_all_time 2,236
  • author_summary 3324 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 3 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=mradermacher (M8 quantization producer, never originator)
  • is_gguf=1
  • base_model='Nekochu/huihui-ai_Qwen3-30B-A3B-abliterated-clone' (base has 'abliterated' marker, assume M1 default)
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
2K
189 last 30d - cooling
Likes
0
Model age
16mo ago
created 2025-05-28
Downloads over time
Now2.3K→from408↑462%
3141K1.8K2.5K408 on May 28, 20252.3K on Oct 11May '25Aug '25Nov '25FebMayAug
May 28, 2025 → Oct 11 · 111 snapshots · spans 501 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 599 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
apache-2.0
Languages
en
Quantizations
IQ4 Q2_K Q3_K Q4_K Q5_K Q6_K Q8_0
Tags
transformers gguf chat abliterated uncensored en license:apache-2.0 endpoints_compatible region:us conversational

Related

Total size
194 GB
Files
13
Quantizations
8
Registered
2026-08-22 13:56
Last updated on HF
2025-07-31 04:05

Files by quantization

Q8_0 1 file 30.3 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q8_0.gguf 30.3 GB f4e5fdff download
Q6_K 1 file 23.4 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q6_K.gguf 23.4 GB 84c592ba download
Q5_K 2 files 39.9 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q5_K_M.gguf 20.2 GB 55bd3580 download
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q5_K_S.gguf 19.6 GB 43c5ed51 download
Q4_K 2 files 33.5 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q4_K_M.gguf 17.3 GB 1c59ffa3 download
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q4_K_S.gguf 16.3 GB 478cb3b1 download
IQ4 1 file 15.4 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.IQ4_XS.gguf 15.4 GB 0c0e304c download
Q3_K 3 files 40.9 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q3_K_L.gguf 14.8 GB acbded4c download
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q3_K_M.gguf 13.7 GB 963113ad download
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q3_K_S.gguf 12.4 GB df908a8d download
Q2_K 1 file 10.5 GB
huihui-ai_Qwen3-30B-A3B-abliterated-clone.Q2_K.gguf 10.5 GB e5e7d596 download
Auxiliary files 2 files 7.68 KB
README.md 5.24 KB e1bb8e2d download
.gitattributes 2.44 KB f0ef3f98 download

README current version from Hugging Face


base_model: Nekochu/huihui-ai_Qwen3-30B-A3B-abliterated-clone
extra_gated_prompt: |-
Usage Warnings

“Risk of Sensitive or Controversial Outputs“: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.
“Not Suitable for All Audiences:“ Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.
“Legal and Ethical Responsibilities“: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.
“Research and Experimental Use“: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.
“Monitoring and Review Recommendations“: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.
“No Default Safety Guarantees“: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.
language:


About

static quants of https://huggingface.co/Nekochu/huihui-ai_Qwen3-30B-A3B-abliterated-clone

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants are available at https://huggingface.co/mradermacher/huihui-ai_Qwen3-30B-A3B-abliterated-clone-i1-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's
READMEs
for
more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
GGUF Q2_K 11.4
GGUF Q3_K_S 13.4
GGUF Q3_K_M 14.8 lower quality
GGUF Q3_K_L 16.0
GGUF IQ4_XS 16.7
GGUF Q4_K_S 17.6 fast, recommended
GGUF Q4_K_M 18.7 fast, recommended
GGUF Q5_K_S 21.2
GGUF Q5_K_M 21.8
GGUF Q6_K 25.2 very good quality
GGUF Q8_0 32.6 fast, best quality

Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

image.png

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.

README history 4 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-07-31auto-patch README.md7f550fb5.2 KB
    Loading...
  2. 2025-05-29auto-patch README.mdcf238ff5.3 KB
    Loading...
  3. 2025-05-28auto-patch README.md058beff5.2 KB
    Loading...
  4. 2025-05-28uploaded from nico13fd083a239 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration