license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.6-27B-abliterated
tags:
- gguf
- ollama
- qwen
- abliterated
- 3bit
- mtp
Huihui-Qwen3.6-27B-abliterated-MTP-Q3_K-GGUF
3-bit GGUF quantization of huihui-ai/Huihui-Qwen3.6-27B-abliterated.
Files Included
Huihui-Qwen3.6-27B-abliterated-ggml-model-Q3_K.gguf(3-bit quantization, 13.5 GB)mmproj-model-f16.gguf(Multimodal vision projector, 927 MB)Modelfile(Ready-to-use Ollama Modelfile)
How to Run with Ollama
- Place both the
.gguffile andModelfilein the same directory. - Run:
ollama create qwen3.6-27b-abliterated -f Modelfile
ollama run qwen3.6-27b-abliterated
How to Run with llama.cpp
llama-cli -m Huihui-Qwen3.6-27B-abliterated-ggml-model-Q3_K.gguf --mmproj mmproj-model-f16.gguf -p "Hello!"
EOF
rm -rf /teamspace/studios/this_studio/models/export_qwen36_q3/.cache
ls -lh /teamspace/studios/this_studio/models/export_qwen36_q3/