Single-direction ablation on a small model (Arditi baseline)
commands
python compute_refusal_dir.py --model <base-model> --samples 512 python inference.py --model <base-model> --direction refusal_dir.pt
Source: Sumandora repository →
Datasets purpose-built for the refusal-direction removal step: activation snapshots, residual-stream probes, and refusal-specific extractions used by tools like Heretic, Sumandora, and huihui-ai to perform the actual weight modification.
python compute_refusal_dir.py --model <base-model> --samples 512 python inference.py --model <base-model> --direction refusal_dir.pt
git clone https://github.com/jim-plus/llm-abliteration cd llm-abliteration python measure.py --model <base> --harmful harmful.txt --harmless harmless.txt --projected python ablate.py --model <base> --direction refusal.pt --normpreserve
pip install -U heretic-llm heretic Qwen/Qwen3-4B-Instruct-2507
Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.