← back to catalog · registered 2026-08-22 13:56

huihui-ai/Huihui-Qwen3.5-9B-abliterated-mlx-4bit

huihui-ai Qwen 9B multimodal
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/huihui-ai%2FHuihui-Qwen3.5-9B-abliterated-mlx-4bit"
Response includes
  • classification m3
  • files 8
  • benchmarks 11 entries
  • author_summary 183 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

No other method signals detected in this model.
Confidence
HIGH
Why this label 3 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=huihui-ai (specializes in M3 layer-wise ablation)
  • is_gguf=0 (base model, not repackage)
  • 'abliterated' in name/tags
Refusal direction extracted via
Extraction technique

huihui-ai layer-band extraction

Confidence
HIGH
Why we say so
producer=huihui-ai (documented layer-band methodology in model cards)
Downloads · 30-day
4K
↑ 1,967% in 90 days
Likes
22
Model age
7mo ago
created 2026-03-10
Downloads over time
Now23K→from1.1K↑1,967%
198.4K16.8K25.2K1.1K on Mar 1123K on Sep 27MarAprMayJunJulAugSep
Mar 11 → Sep 27 · 57 snapshots · spans 200 days

Benchmarks

Portrait before abliteration
Benchmarks of the base model as it stood before the refusal-removal operation. Compare with the numbers above to see what the operation cost.
Benchmark Score Source
Entertainment 1.4 UGI
Hazardous 2.4 UGI
Natural Intelligence 17.62 UGI
Political lean -12.2% UGI
Sensitive-Info 14.65 UGI
SocPol 0.9 UGI
UGI 17.27 UGI
Willingness (10) 2.2 UGI
W10-Adherence 1.5 UGI
W10-Direct 3 UGI
Writing 33.52 UGI

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
transformers safetensors qwen3_5 image-text-to-text abliterated uncensored mlx conversational base_model:Qwen/Qwen3.5-9B base_model:quantized:Qwen/Qwen3.5-9B license:apache-2.0 endpoints_compatible

Related

Total size
4.69 GB
Files
8
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-03-10 05:22

Files by quantization

Auxiliary files 8 files 4.71 GB
model.safetensors 4.69 GB 908d38f0 download
tokenizer.json 19.1 MB 87a7830d download
model.safetensors.index.json 79.3 KB 92d6b1e9 download
chat_template.jinja 7.57 KB a585dec8 download
README.md 2.79 KB eabfe196 download
config.json 2.78 KB c2096aaa download
.gitattributes 1.53 KB 52373fe2 download
tokenizer_config.json 1.11 KB f57cfc38 download

README current version from Hugging Face


library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3.5-9B/blob/main/LICENSE
pipeline_tag: image-text-to-text
base_model:

  • Qwen/Qwen3.5-9B
    tags:
  • abliterated
  • uncensored
  • mlx

huihui-ai/Huihui-Qwen3.5-9B-abliterated-mlx-4bit

This is an uncensored version of Qwen/Qwen3.5-9B created with abliteration (see remove-refusals-with-transformers to know more about it).

This is just the MLX model we generated under Linux using mlx-lm version 0.31.0; it hasn’t been tested in an Apple environment. If there are any issues, please let us know.

Usage

from mlx_lm import load, generate

model, tokenizer = load("huihui-ai/Huihui-Qwen3.5-9B-abliterated-mlx-4bit")

prompt = "Write a story about Einstein"

messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

print(text)

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

If you like it, please click 'like' and follow us for more updates.
You can follow x.com/support_huihui to get the latest model information from huihui.ai.

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin(BTC):
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge

README history 4 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-10Update README.md151c6e02.8 KB
    Loading...
  2. 2026-03-10Update README.md357420a2.8 KB
    Loading...
  3. 2026-03-10Add files using upload-large-folder toola861c2381 B
    Loading...
  4. 2026-03-10Create README.md1602cbe2.8 KB
    Loading...

Discussions 1 thread

  1. 2026-04-05The vision tower is missingopen2 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration