base_model: SicariusSicariiStuff/Wingless_Imp_8B_Abliterated
base_model_relation: quantized
license: llama3.1
language:
- en
Llama.cpp Quantization of Wingless_Imp_8B_Abliterated by SicariusSicariiStuff
Using llama.cpp release b8914 for quantization.
Original model: SicariusSicariiStuff/Wingless_Imp_8B_Abliterated
Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Description |
|---|---|---|---|
| SicariusSicariiStuff_Wingless_Imp_8B_Abliterated-GGUF-Q8_0.gguf | Q8_0 | 8.54GB | High quality. |
| SicariusSicariiStuff_Wingless_Imp_8B_Abliterated-GGUF-Q4_K_M.gguf | Q4_K_M | 4.92GB | Good quality. |