base_model:
- Naphula/MN-12B-Mag-Mell-R1-Uncensored
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags: - exl3
- 4-bit
- 6-bit
- 8-bit
Original model: MN-12B-Mag-Mell-R1-Uncensored by Naphula
Available ExLlamaV3 (release v0.0.18) quantizations
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 7.48 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 10.21 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 12.94 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.