license: mit
language:
- en
base_model: - deepreinforce-ai/Ornith-1.0-35B
pipeline_tag: text-generation
tags: - ornith
- abliterated
- uncensored
- gguf
Ornith-35B Uncensored
A refusal-ablated build of Ornith-1.0-35B (Qwen3.5-style Mixture-of-Experts, A3B active). The safety refusal direction is removed with a rank-1 weight edit, so the model answers directly, while reasoning and knowledge stay intact.
Uncensored. Undamaged. Fast.
| Base | Ornith-1.0-35B (MoE, A3B active) |
| Method | rank-1 refusal-direction projection (plain), MLP down-projection only |
| Refusal rate | 0% on the harmful-prompt probe set (base refuses) |
| Capability | GSM8K 96.0% vs base 94.0% (within noise, no measurable loss) |
| KL vs base | 0.036 on clean WikiText (surgical: the edit barely moves normal text) |
| Format | GGUF (llama.cpp), Q8_0 and Q4_K_M |
What this is
Ornith-35B is a strong general model that, like most instruct models, refuses a class of requests. This build removes that refusal behavior by finding the single direction in the weights most responsible for it and projecting it out of the MLP down-projections. Nothing is retrained. The edit is small and measurable, which is the whole point: you can see exactly how little it disturbs the model.
It stays smart
The honest question with any abliteration is "what did you break?" So we measured it. GSM8K (5-shot, the same harness for base and edited, thinking disabled for a clean comparison):
| Model | GSM8K (base) | GSM8K (abliterated) | Change |
|---|---|---|---|
| Ornith-35B | 94.0% | 96.0% | +2.0pp (noise) |
| Ornith-9B | 89.5% | 87.0% | -2.5pp |
The 35B lands within measurement noise of the base model. Removing refusal did not cost it reasoning.
And it is the strongest of the abliterations
Same base, same benchmark, same harness for every build. This one comes out on top:
| Build | GSM8K | Note |
|---|---|---|
| base | 94.0% | reference |
| Ornith-35B Uncensored (this) | 96.0% | uncensored, best retention |
| yuyu | 94.5% | other public abliteration |
How surgical the edit is
Abliteration can be done badly. Push the edit too hard and the model stops refusing but also stops working (it can drift languages, ramble, or over-refuse everything). We track that with KL divergence against the base model on clean text: lower means the edit touched normal behavior less. This build sits at KL 0.036, measured on held-out WikiText. The refusal is gone; ordinary generation is essentially unchanged.
Files
GGUF quants (llama.cpp). Sizes are approximate.
| Quant | Size | Notes |
|---|---|---|
| Q8_0 | ~37 GB | reference quality |
| Q4_K_M | ~21 GB | balanced, smaller footprint |
Usage
llama.cpp server:
llama-server -m Ornith-1.0-35B-abliterated-SatGeZe-Q8_0.gguf -ngl 99 -c 8192
Then point any OpenAI-compatible client at http://localhost:8080/v1.
Context
Native context is supported directly. Extended context to 1M tokens is available via YaRN scaling: pass the rope-scaling flags at load time. Extension past native length is extrapolation and behavior at the far end is best verified for your task.
Method
The whole edit is a single rank-1 projection, chosen so it is small enough to see and measure. No retraining, no LoRA, no distillation.
- Direction discovery. Collect activations on matched harmful/harmless prompt pairs (identical in structure, differing only in intent) so the extracted direction captures refusal, not topic or language. Take the difference of means per layer and normalize.
- Rank-1 removal. Project that direction out of the MLP down-projection weights with
W' = W - s·(W·r)·r, plain mode, at scale s = 1.2. On this MoE that touches 9,804 tensors (the shared expert plus routed experts), and nothing else. - Scale by measurement, not by feel. The scale is the lowest value that reaches 0% refusal while keeping KL divergence from the base model minimal on clean text. Here that lands at KL 0.036.
- Convert and quantize. BF16 source →
--no-mtpf16 GGUF → Q8_0 and Q4_K_M. - Verify on a real-world gate, not a refusal count. Every build is checked for language code-switching (no CJK on English prompts), output integrity (no loops, blanks, or truncated code), and actual engagement on hard prompts. A "0% refusal" number that fails coherence does not ship.
Credits
Base model: Ornith-1.0-35B by DeepReinforce. Abliteration and packaging by satgeze.
Note
This model will answer requests that the base model refuses. It has no additional guardrails. You are responsible for how you use it and for complying with the laws that apply to you.