base_model: meta-llama/Llama-3.2-3B-Instruct
library_name: llama.cpp
tags:
- abliterated
- uncensored
- gguf
- llama-3.2
- text-generation
quantized_by: lecheyne24
llama-3.2-3b-abliterated (Q4_K_M, GGUF)
Uncensored build of meta-llama/Llama-3.2-3B-Instruct.
- Method: refusal-direction ablation (abliteration) followed by a LoRA SFT on a plain-answer corpus, merged, converted to GGUF and quantised to Q4_K_M.
- Quant: Q4_K_M (llama.cpp
llama-quantize --allow-requantize) - File:
llama-3.2-3b-abliterated.Q4_K_M.gguf - Plain-answer gauntlet: 7/8 (only miss: "I cannot predict the future performance of the stock market." for financial-call)
Run
llama-server -m llama-3.2-3b-abliterated.Q4_K_M.gguf --port 8082 -c 4096 --alias llama-3.2-3b
OpenAI-compatible endpoint at http://localhost:8082/v1.