base_model: llmfan46/Qwen3.5-9B-ultra-uncensored-heretic-v2
tags:
- llama.cpp
- quantized
- imatrix
Auto-Quantized GGUF Model
This repository contains automated GGUF quantization files for llmfan46/Qwen3.5-9B-ultra-uncensored-heretic-v2.
The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.
imatrix 的校准数据以中文的小说、角色扮演为目标,同时保留逻辑和常识。
📊 Perplexity Evaluation
(Tested against the provided calibration dataset)
- Base (F16/BF16): PPL = 14.2066 +/- 0.11553
- IQ4_XS: PPL = 12.0006 +/- 0.09439
- IQ4_NL: PPL = 12.0064 +/- 0.09447
- Q4_K_M: PPL = 11.9559 +/- 0.09373