← back to catalog · registered 2026-08-22 13:56

cs2764/Qwen3.5-397B-A17B-6bit-abliterated-mlx

cs2764 Qwen 396B MoE
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/cs2764%2FQwen3.5-397B-A17B-6bit-abliterated-mlx"
Response includes
  • classification m1
  • files 74
  • hub_downloads_all_time 2,339
  • author_summary 28 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
2K
201 last 30d - cooling
Likes
5
Model age
7mo ago
created 2026-03-03
Downloads over time
Now2.4K→from267↑811%
1599891.8K2.6K267 on Mar 42.4K on Oct 11MarAprMayJunJulAugSepOct
Mar 4 → Oct 11 · 71 snapshots · spans 221 days

Metadata

License
other
Tags
mlx safetensors qwen3_5_moe abliteration uncensored experimental license:other 6-bit region:us

Related

Total size
301 GB
Files
74
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-03-03 06:32

Files by quantization

Auxiliary files 74 files 301 GB
model-00018-of-00061.safetensors 4.98 GB 248b8244 download
model-00022-of-00061.safetensors 4.98 GB 715354f5 download
model-00023-of-00061.safetensors 4.98 GB a7025236 download
model-00026-of-00061.safetensors 4.98 GB 39afb247 download
model-00027-of-00061.safetensors 4.98 GB 4331a148 download
model-00029-of-00061.safetensors 4.98 GB 8ec9143a download
model-00031-of-00061.safetensors 4.98 GB 5105142d download
model-00033-of-00061.safetensors 4.98 GB f89e9689 download
model-00034-of-00061.safetensors 4.98 GB 0f15c9e5 download
model-00038-of-00061.safetensors 4.98 GB 5dc6950c download
model-00039-of-00061.safetensors 4.98 GB cda29450 download
model-00046-of-00061.safetensors 4.98 GB cfa164bd download
model-00051-of-00061.safetensors 4.98 GB af470a59 download
model-00054-of-00061.safetensors 4.98 GB f2b6b42f download
model-00057-of-00061.safetensors 4.98 GB 9cdc99b3 download
model-00035-of-00061.safetensors 4.98 GB a0e4794c download
model-00058-of-00061.safetensors 4.98 GB 3cfa2787 download
model-00059-of-00061.safetensors 4.98 GB f8b93080 download
model-00043-of-00061.safetensors 4.98 GB 0f549378 download
model-00013-of-00061.safetensors 4.98 GB 9700eb9b download
model-00017-of-00061.safetensors 4.98 GB 4fb0f4ec download
model-00037-of-00061.safetensors 4.98 GB 18d309e2 download
model-00053-of-00061.safetensors 4.98 GB 875d393a download
model-00055-of-00061.safetensors 4.98 GB 1fab53ff download
model-00015-of-00061.safetensors 4.98 GB 73da50d0 download
model-00021-of-00061.safetensors 4.98 GB b59ccb63 download
model-00030-of-00061.safetensors 4.98 GB 2b3facc9 download
model-00025-of-00061.safetensors 4.98 GB 83a045be download
model-00011-of-00061.safetensors 4.98 GB 196dc501 download
model-00042-of-00061.safetensors 4.98 GB 7510b723 download
model-00007-of-00061.safetensors 4.98 GB 0c712710 download
model-00010-of-00061.safetensors 4.98 GB eee2f871 download
model-00050-of-00061.safetensors 4.98 GB 446c52cd download
model-00041-of-00061.safetensors 4.98 GB 3f9c5d84 download
model-00005-of-00061.safetensors 4.98 GB 0ec1cd99 download
model-00014-of-00061.safetensors 4.98 GB 7768e908 download
model-00047-of-00061.safetensors 4.98 GB 2e0c3075 download
model-00019-of-00061.safetensors 4.98 GB 88b2ea97 download
model-00049-of-00061.safetensors 4.98 GB ddaf53a7 download
model-00006-of-00061.safetensors 4.98 GB 3b911e7f download
model-00003-of-00061.safetensors 4.98 GB 20b07ec7 download
model-00009-of-00061.safetensors 4.98 GB e60dd693 download
model-00045-of-00061.safetensors 4.98 GB 03e62872 download
model-00002-of-00061.safetensors 4.98 GB f5574a15 download
model-00020-of-00061.safetensors 4.97 GB d0a50092 download
model-00016-of-00061.safetensors 4.97 GB 01bc6066 download
model-00044-of-00061.safetensors 4.97 GB 79ac1f99 download
model-00040-of-00061.safetensors 4.97 GB c5e19a3c download
model-00060-of-00061.safetensors 4.97 GB 790c1cab download
model-00048-of-00061.safetensors 4.97 GB c8718773 download
model-00032-of-00061.safetensors 4.97 GB 94a09389 download
model-00028-of-00061.safetensors 4.97 GB 095f1f4a download
model-00012-of-00061.safetensors 4.97 GB 4382e720 download
model-00024-of-00061.safetensors 4.97 GB 86d94064 download
model-00056-of-00061.safetensors 4.97 GB 08fad640 download
model-00036-of-00061.safetensors 4.97 GB e1042257 download
model-00008-of-00061.safetensors 4.97 GB 75dc3417 download
model-00052-of-00061.safetensors 4.97 GB 2368cfcf download
model-00004-of-00061.safetensors 4.97 GB 5114edf1 download
model-00001-of-00061.safetensors 4.97 GB d1888095 download
model-00061-of-00061.safetensors 2.40 GB 414e98c3 download
tokenizer.json 19.1 MB 87a7830d download
vocab.json 6.41 MB 0aa0ce06 download
model.safetensors.index.json 302 KB 1237e5c2 download
chat_template.jinja 7.57 KB a585dec8 download
config.json 4.34 KB 78bd66b5 download
README.md 2.03 KB 81eab67a download
.gitattributes 1.53 KB 52373fe2 download
processor_config.json 1.27 KB 7ad6acdf download
tokenizer_config.json 1.15 KB 040f6e4b download
abliteration_log.json 1.12 KB 5be886b9 download
preprocessor_config.json 390 B 2ea84a43 download
video_preprocessor_config.json 385 B 3ba673a5 download
generation_config.json 244 B 85b45ab4 download

README current version from Hugging Face


tags:

  • mlx
  • abliteration
  • uncensored
  • experimental
    license: other

Qwen3.5-397B-A17B-6bit-abliterated

This model was created using the mlx-abliteration toolkit,
which is based on the FiditeNemini/mlx-abliteration project.

Base Model

Original model: ./models/Qwen3.5-397B-A17B-6bit (local path)

What is Abliteration?

Abliteration is a mechanistic interpretability technique that identifies and orthogonalizes the
"refusal direction" in a model's activation space, surgically removing refusal behavior without
full fine-tuning.

Abliteration Parameters

Parameter Value
Base model ./models/Qwen3.5-397B-A17B-6bit
Ablation method projection
Refusal vector policy per-layer
Refusal direction method projected
Ablation strength 2.0
Probed layers all
PCA components (ablate-k) 1
Attention only True
Timestamp 2026-03-03T05:02:07 UTC

This model uses a Mixture-of-Experts (MoE) architecture. Abliteration targets only the attention projection weights (q/k/v/o_proj) to preserve expert routing quality.

⚠️ Disclaimer

This model is intended for research, experimentation, and testing purposes only.

  • This model may produce harmful, offensive, inappropriate, or otherwise objectionable content.
  • The abliteration process removes safety guardrails that were intentionally built into the original model.
  • Do not use this model in production systems, consumer-facing applications, or any context
    where harmful outputs could cause real-world harm.
  • The authors and contributors of this toolkit bear no responsibility for any misuse of this model
    or any harm caused by outputs generated by this model.
  • By using this model, you agree that you are solely responsible for ensuring its use complies
    with all applicable laws and ethical guidelines.

This model is shared purely for academic and technical exploration of model internals.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-03Add files using upload-large-folder toolce561952 KB
    Loading...

Discussions 1 thread

  1. 2026-03-08model speed feedbackclosed3 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration