tags:
- quantized
- safetensors
- int8
- uncensored
- abliterated
library_name: transformers
gemma-4-31B-it-Uncensored-Aquarion-INT8
INT8 weight-only safetensors quantization of gemma-4-31B-it-Uncensored.
Aquarion Forge
This model was abliterated (uncensored) via orthogonal projection of the
refusal direction before quantization — part of the Genesis of Aquarion forge.
Quantization Details
- Base model:
gemma-4-31B-it-Uncensored - Format: INT8 (weight-only safetensors)
- Method: PyTorch RTN quantization on CPU; scales stored alongside weights
Loading
These use custom weight-only recipes. Dequantize with the matching scale/shape
buffers (*.weight_scale, *.weight_shape) before feeding to an inference engine.