base_model: llmfan46/Qwen3.8-27B-Uncensored-Heretic-Native-MTP-Preserved
base_model_relation: quantized
pipeline_tag: text-generation
library_name: exllamav3
EXL3 quants of llmfan46/Qwen3.8-27B-Uncensored-Heretic-Native-MTP-Preserved
- Model Commit: 4b9e1517a43fdca25872318ed272a1c88e72c360
- ExLlamaV3: 1.6.1
- Command:
python -m exllamav3.conversion.convert_model --in_dir "./llmfan46__Qwen3.8-27B-Uncensored-Heretic-Native-MTP-Preserved/" --out_dir "./4.0bpw_H6_V6" --work_dir "./workdir/" --bits 4 --mtp_bits 4 --head_bits 6 --vision_bits 6 --devices 0,1 - llmfan46's repo lacks
preprocessor_config.json, and theprocessor_config.jsonit has is not compatible, so I usedpreprocessor_config.jsonfrom Qwen/Qwen3.8-27B repo.
Weights:
- 4.0 bits per weight (MTP4,H6,V6)
- 5.0 bits per weight (MTP4,H6,V6)
- 6.0 bits per weight (MTP4,H6,V6)