license: apache-2.0
base_model: Qwen/Qwen2.5-7B-Instruct
tags:
- abliterated
- uncensored
- gguf
- qwen2.5
Qwen2.5-7B-Instruct-Abliterated-bro-GGUF
Abliterated version of Qwen2.5-7B-Instruct.
Quantizations
| File | Type | Notes |
|---|---|---|
*-Q4_K_M.gguf |
Q4_K_M | Best daily driver |
*-Q5_K_M.gguf |
Q5_K_M | Higher quality |
*-Q6_K.gguf |
Q6_K | Very high quality |
*-Q8_0.gguf |
Q8_0 | Near lossless |
*-F16.gguf |
F16 | Full precision |