base_model:
- huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags: - quantization
- qwen
- gguf
- qwen
- qwen3.5
- abliterated
- uncensored
- 4bit
Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M
GGUF 4bit conversion of huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated.
Example
llama-cli \
-m path/to/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
--n-gpu-layers all \
--ctx-size 262144 \
--flash-attn on