language:
- en
tags: - lfm3
- abliteration
- gguf
- research
LFM3-1.7B abliterated - f16 GGUF
Refusal direction (layer 13, 64 harmful vs 64 harmless prompts) orthogonalised out of all
49 residual-stream writers. Measured on 40 held-out harmful prompts:
| base | abliterated | |
|---|---|---|
| refusal rate | 100% (40/40) | 22.5% (9/40) |
| perplexity | 10.60 | 11.44 |
f16 is a floating-point format, not a quantised one.
huggingface-cli download Dhdjxkxdnsbzj/lfm3-1.7b-abliterated-gguf \
--repo-type model --local-dir ./abl
ollama create lfm3-abliterated -f ./abl/Modelfile.lfm3-abliterated
The chat template defaults enable_thinking=false (LFM3 otherwise emits an open thinking
and loops). For tool calling use llama-server --jinja or Ollama's /v1 endpoint.