tags: [bonfyre-fpq, native-format, compressed, gemma-2, abliterated]
license: gemma
base_model: IlyaGusev/gemma-2-9b-it-abliterated
Gemma-2-9B-IT Abliterated — BonfyreFPQ Native Format
IlyaGusev/gemma-2-9b-it-abliterated compressed into BonfyreFPQ v4.
| File | Tensors | BF16 Source | FPQ Size | Ratio |
|---|---|---|---|---|
| model-part1.fpq | 84 | ~4.57 GB | 274 MB | ~17.1× |
| model-part2.fpq | 141 | ~4.61 GB | 290 MB | ~17.1× |
| model-part3.fpq | 134 | ~4.62 GB | 291 MB | ~17.1× |
| model-part4.fpq | 105 | ~3.42 GB | 215 MB | ~17.1× |
| Total | 464 | ~17.2 GB | 1.07 GB | ~17.1× |
FPQ v4 | COORD@3+QJL | 3.50 avg bpw | 9.1× FP32-equiv ratio