license: gemma
license_link: https://ai.google.dev/gemma/terms
base_model: google/gemma-4-12B-it
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
language:
- en
tags: - gguf
- solus
- gemma4
- uncensored
- creative-writing
- roleplay
Gemma 4 12B QAT Uncensored (Balanced) — Solus v1
A community-modified Gemma 4 12B with its refusal behaviour removed, built from Google's official quantisation-aware-trained weights so the 4-bit build stays close to full-precision quality. Capabilities and training data are otherwise unchanged from the original.
The "Balanced" variant is tuned to stay reliable and on-instruction rather than merely compliant, and it is aimed at creative writing and roleplay. Because the safety refusals are gone, replies can be blunt or mature; treat its output accordingly.
The upstream author's recommended sampling settings are temperature 0.6, top_k 64, top_p 0.9, min_p 0.05, and repeat_penalty 1.1.
Specifications
| Parameters | 12B |
| Quantization | Q4_K_M |
| File size | 6.87 GB |
| Minimum RAM | 12.00 GB |
| Minimum VRAM | 8.00 GB |
| Context length | 32,768 tokens |
| SHA-256 | 59656d7494d6376ca97e9e20b64ea2e16cd97f12ec6d47bfccba91cb785b5134 |
Single file: Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced-Q4_K_M.gguf
Quantization
Quantization performed at the Faculty of Engineering, McMaster University.
The GGUF conversion this build is derived from was produced by
HauhauCS, and the
weights here are a byte-for-byte copy of that file — the SHA-256 above matches
the upstream artifact.
Provenance
- Original model: google/gemma-4-12B-it
- Upstream GGUF: HauhauCS/Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
- Mirrored for Solus, a desktop app for running language models entirely on your own machine.
Usage
llama-cli -m Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced-Q4_K_M.gguf -cnv
License
Gemma is provided under and subject to the Gemma Terms of Use. Use is additionally subject to the Gemma Prohibited Use Policy, which passes through to anyone who obtains this model. Removal of refusal behaviour does not remove those obligations.