base_model: mistralai/Mistral-7B-Instruct-v0.3
library_name: llama.cpp
tags:
- abliterated
- uncensored
- gguf
- mistral
- text-generation
quantized_by: lecheyne24
mistral-7b-abliterated (Q4_K_M, GGUF)
Uncensored build of mistralai/Mistral-7B-Instruct-v0.3.
- Method: refusal-direction rank-1 norm-preserving biprojection (o_proj + down_proj), alpha 1.25, all layers.
- Quant: Q4_K_M
- Files:
Mistral-7B-Instruct-v0.3-abliterated.Q4_K_M.gguf,mistral-7b-unbound.Q4_K_M.gguf - Plain-answer gauntlet: 7/8. Only miss: financial-call answered "positive growth" instead of committing "higher".
Run
llama-server -m Mistral-7B-Instruct-v0.3-abliterated.Q4_K_M.gguf --port 8083 -c 4096 --alias mistral-7b