base_model: huihui-ai/Huihui-Qwen3.5-35B-A3B-abliterated
tags:
- gguf
- abliterated
- uncensored
- conversational
- qwen3_5_moe
- llama-cpp
library_name: gguf
license: apache-2.0
[!WARNING]
A significantly improved version of this model is available.This repo quantizes huihui-ai/Huihui-Qwen3.5-35B-A3B-abliterated — the standard abliteration.
A newer fine-tune of the same architecture, trained in the style of Claude 4.6 Opus, has since been released and produces noticeably richer, more expressive outputs.➡️ Recommended upgrade: Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF
Same architecture, same Q4_K_M quantization, same VRAM footprint — just a better fine-tune. This repo will remain available for reference.
Huihui-Qwen3.5-35B-A3B-abliterated — Q4_K_M GGUF
This is a Q4_K_M GGUF quantization of huihui-ai/Huihui-Qwen3.5-35B-A3B-abliterated.
Refer to the original model card for full details, usage warnings, and licensing information.
Details
| Property | Value |
|---|---|
| Source model | huihui-ai/Huihui-Qwen3.5-35B-A3B-abliterated |
| Architecture | qwen35moe (35B total params, ~3B active; 256 experts, 8 active per token) |
| Quantization | Q4_K_M (~4.8 BPW) |
| File size | ~21 GB |
| Quantized with | llama.cpp |
Usage with llama.cpp
llama-cli \
--hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-abliterated-Q4_K_M-GGUF \
--hf-file huihui-qwen3.5-35b-a3b-abliterated-Q4_K_M.gguf \
-p "Tell me about the universe"
llama-server \
--hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-abliterated-Q4_K_M-GGUF \
--hf-file huihui-qwen3.5-35b-a3b-abliterated-Q4_K_M.gguf \
-c 8192
Usage with Ollama
Requires Ollama with qwen35moe support. See PR #14506 for the architecture patch.
ollama run hf.co/cesarsal1nas/Huihui-Qwen3.5-35B-A3B-abliterated-Q4_K_M-GGUF
Credits
- Abliteration by huihui-ai — Huihui-Qwen3.5-35B-A3B-abliterated
- Base model by Qwen — Qwen3.5-35B-A3B
- Quantization by cesarsal1nas