base_model: toandev/Spark-X2.5-4B-Uncensored
tags:
- llama.cpp
- gguf
- abliterated
- uncensored
license: apache-2.0
Spark-X2.5-4B-Uncensored - GGUF
This repository contains GGUF quantized formats of toandev/Spark-X2.5-4B-Uncensored, fine-tuned/abliterated by Toan Doan ([email protected]).
These quantized models are optimized for efficient local inference with llama.cpp, Ollama, LM Studio, and other compatible runtimes across consumer GPUs and CPUs.
Provided Quantizations
| File | Quant Method | File Size | Description |
|---|---|---|---|
Spark-X2.5-4B-Uncensored-Q4_K_M.gguf |
Q4_K_M | 2.65 GB | Standard balanced 4-bit quant. Recommended for fast inference and GPUs with 4GB–6GB VRAM. |
Spark-X2.5-4B-Uncensored-Q5_K_M.gguf |
Q5_K_M | 3.05 GB | 5-bit quant. Enhanced quality with minimal memory footprint (~6GB VRAM). |
Spark-X2.5-4B-Uncensored-Q8_0.gguf |
Q8_0 | 4.50 GB | 8-bit quant. Near-original 16-bit precision. |
Reference & Evaluation Benchmarks
For complete details on the abliteration methodology, safety evaluation benchmarks across 5 standard datasets (AdvBench, MaliciousInstruct, JailbreakBench, HarmBench, StrongREJECT), and usage instructions, please refer to the primary model card: