license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.8-27B-abliterated
tags:
- bitsandbytes
- 4-bit
- nf4
Huihui-Qwen3.8-27B-abliterated, bitsandbytes NF4
huihui-ai/Huihui-Qwen3.8-27B-abliterated
at commit 739e3c5b89849f6c238ce1e5b70008612ae42cdd, vision tower included, quantized by transformers'BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16)
and written with save_pretrained. 19 GB against the original's 52 GB.
The tokenizer, chat template and processor files are the original commit's, unchanged.