← back to catalog · registered 2026-08-22 13:56

vanch007/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16

vanch007 Qwen 35B MoE multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/vanch007%2FHuihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16"
Response includes
  • classification m1
  • files 27
  • hub_downloads_all_time 3,000
  • author_summary 27 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
3K
157 last 30d - cooling
Likes
1
Descendants
1
in 1 direct fork
Model age
5mo ago
created 2026-04-20
Downloads over time
Now3.1K→from949↑222%
8441.6K2.5K3.3K949 on Apr 223.1K on Oct 11AprMayJunJulAugSepOct
Apr 22 → Oct 11 · 64 snapshots · spans 172 days

Genealogy 1 direct fork

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Tags
mlx-vlm safetensors qwen3_5_moe mlx qwen3.6 multimodal vision-language lm-studio abliterated image-text-to-text conversational base_model:huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated

Related

Total size
65.4 GB
Files
27
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-04-20 17:23

Files by quantization

Auxiliary files 27 files 65.4 GB
model-00001-of-00014.safetensors 4.98 GB eb9d1088 download
model-00013-of-00014.safetensors 4.71 GB 30e2d4db download
model-00005-of-00014.safetensors 4.71 GB 77111ba5 download
model-00009-of-00014.safetensors 4.71 GB 1b65f833 download
model-00010-of-00014.safetensors 4.70 GB 898e825d download
model-00006-of-00014.safetensors 4.70 GB 1d22edc0 download
model-00012-of-00014.safetensors 4.70 GB 669bcabe download
model-00011-of-00014.safetensors 4.70 GB c9d097d8 download
model-00007-of-00014.safetensors 4.70 GB 6f0c6034 download
model-00004-of-00014.safetensors 4.70 GB 7f94678f download
model-00002-of-00014.safetensors 4.70 GB 9ec6af66 download
model-00008-of-00014.safetensors 4.70 GB 9ed16c19 download
model-00003-of-00014.safetensors 4.70 GB 8e4673d5 download
model-00014-of-00014.safetensors 4.01 GB ef5b0983 download
tokenizer.json 19.1 MB 87a7830d download
vocab.json 6.41 MB 0aa0ce06 download
model.safetensors.index.json 104 KB e00c5717 download
chat_template.jinja 7.58 KB a8755d82 download
config.json 3.66 KB 313c1b2c download
README.md 1.71 KB aa4d67ea download
.gitattributes 1.53 KB 52373fe2 download
processor_config.json 1.27 KB 7ad6acdf download
tokenizer_config.json 1.11 KB a068e246 download
preprocessor_config.json 390 B 2ea84a43 download
video_preprocessor_config.json 385 B 3ba673a5 download
generation_config.json 202 B 023756cf download
configuration.json 58.0 B d24dba94 download

README current version from Hugging Face


library_name: mlx-vlm
pipeline_tag: image-text-to-text
base_model: huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated

tags:

  • mlx
  • mlx-vlm
  • qwen3.6
  • multimodal
  • vision-language
  • lm-studio
  • abliterated

Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16

MLX-VLM conversion of huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated.

Overview

  • Format: MLX-VLM
  • Precision: bf16
  • Size: 66G
  • Source model type: Qwen3_5MoeForConditionalGeneration
  • Source pipeline: image-text-to-text
  • Intended runtime: mlx-vlm, LM Studio

Validation

Local checks on Apple Silicon:

  • model loading in mlx-vlm: passed
  • text generation smoke test: passed
  • image generation path smoke test: passed

Smoke-test logs were produced locally before upload.

Notes

This is an abliterated model conversion. Outputs may be less filtered than standard instruction-tuned models. Use responsibly and comply with applicable laws and platform policies.

Files

Important files in this repo:

  • config.json
  • generation_config.json
  • chat_template.jinja
  • tokenizer.json
  • tokenizer_config.json
  • model.safetensors.index.json
  • model-*.safetensors

Usage

Text generation

mlx_vlm.generate \
  --model /path/to/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 \
  --prompt "你好" \
  --max-tokens 128 \
  --trust-remote-code \
  --processor-kwargs '{"enable_thinking": false}'

Image prompt

mlx_vlm.generate \
  --model /path/to/Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16 \
  --image /path/to/example.png \
  --prompt "Describe this image." \
  --max-tokens 128 \
  --trust-remote-code \
  --processor-kwargs '{"enable_thinking": false}'

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-04-20Upload README.md for Huihui-Qwen3.6-35B-A3B-abliterated-mlx-bf16e8ff9ae1.7 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration