base_model: HauhauCS/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive
tags:
- llama.cpp
- quantized
- imatrix
Auto-Quantized GGUF Model
This repository contains automated GGUF quantization files for HauhauCS/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive.
The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.
imatrix 的校准数据以中文的小说、角色扮演为目标,同时保留逻辑和常识。
📊 Perplexity Evaluation
(Tested against the provided calibration dataset)
- Base (F16/BF16): PPL = 15.7332 +/- 0.13581
- IQ4_XS: PPL = 13.1793 +/- 0.10977
- Q4_K_S: PPL = 13.1994 +/- 0.10980
- Q4_K_M: PPL = 13.1506 +/- 0.10930
- Q5_K_M: PPL = 13.0968 +/- 0.10904