← back to catalog · registered 2026-08-22 13:56

huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF

huihui-ai Qwen 235B GGUF multimodal 262K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/huihui-ai%2FHuihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF"
Response includes
  • classification m8
  • files 2
  • benchmarks 11 entries
  • hub_downloads_all_time 16,380
  • author_summary 185 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of layer-wise ablation inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=huihui-ai + is_gguf=1
  • M3 (huihui abliteration) wrapped in M8 (GGUF quantization)
Refusal direction extracted via
Extraction technique

huihui-ai layer-band extraction

Confidence
HIGH
Why we say so
producer=huihui-ai (documented layer-band methodology in model cards)
Downloads · lifetime
16K
2K last 30d - cooling
Likes
33
Model age
11mo ago
created 2025-10-22
Downloads over time
Now16.5K→from1.3K↑1,181%
5276.4K12.2K18K1.3K on Oct 22, 202516.5K on Oct 5Oct '25Dec '25FebAprJunAugOct
Oct 22, 2025 → Oct 5 · 89 snapshots · spans 348 days

Benchmarks

Portrait before abliteration
Benchmarks of the base model as it stood before the refusal-removal operation. Compare with the numbers above to see what the operation cost.
Benchmark Score Source
Entertainment 2.2 UGI
Hazardous 5.9 UGI
Natural Intelligence 28.43 UGI
Political lean -22.7% UGI
Sensitive-Info 39.59 UGI
SocPol 4.6 UGI
UGI 45.56 UGI
Willingness (10) 5.8 UGI
W10-Adherence 6.5 UGI
W10-Direct 5 UGI
Writing 43 UGI

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
transformers gguf abliterated uncensored GGUF image-text-to-text base_model:Qwen/Qwen3-VL-235B-A22B-Instruct base_model:quantized:Qwen/Qwen3-VL-235B-A22B-Instruct license:apache-2.0 endpoints_compatible region:us conversational

Related

Total size
0 B
Files
2
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-12-06 14:39

Files by quantization

Auxiliary files 2 files 5.28 KB
README.md 3.17 KB e5702351 download
.gitattributes 2.12 KB 0181893d download

README current version from Hugging Face


license: apache-2.0
pipeline_tag: image-text-to-text
library_name: transformers
base_model:

  • Qwen/Qwen3-VL-235B-A22B-Instruct
    tags:
  • abliterated
  • uncensored
  • GGUF

huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF

This is an uncensored version of Qwen/Qwen3-VL-235B-A22B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it).

It was only the text part that was processed, not the image part.

The abliterated model will no longer say "I can’t describe or analyze this image."

GGUF

The official llama.cpp-b6907 has now been updated to support Qwen3-VL conversion to GGUF format and can be tested using llama-mtmd-cli.

huggingface-cli download huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF --local-dir ./huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF --token xxx

llama-gguf-split --merge huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF/GGUF/Q2_K/Q2_K-00001-of-00002.gguf huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF/GGUF/Q2_K.gguf

llama-mtmd-cli -m huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF/GGUF/Q2_K.gguf --mmproj huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF/GGUF/mmproj-ggml-model-f16.gguf -c 4096 --image png/cc.jpg -p "Describe this image." 

If it's just for chatting, you can use llama-cli.

llama-cli -m huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF/GGUF/Q2_K.gguf -c 40960

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
  • Support our work on Ko-fi!

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-12-06Super-squash branch 'main' using huggingface_hub704667c3.2 KB
    Loading...

Discussions 5 threads

  1. 2026-02-07Qwen3-VL-235B-A22B-Instruct-FP8abliterated , Qwen3-VL-235B-A22B-Thinking-FP8-ab…closed1 💬#5
    Loading...
  2. 2025-12-15Is it possible to get AWQ version ?open12 💬#4
    Loading...
  3. 2025-11-12If possible, please make GGUF Q8 version tooopen17 💬#3
    Loading...
  4. 2025-10-26Re-quantize is required for future versionclosed5 💬#2
    Loading...
  5. 2025-10-23Dataset size?closed3 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration