library_name: transformers
tags:
- heretic
- uncensored
- decensored
- abliterated
base_model: - typhoon-ai/typhoon2.5-qwen3-30b-a3b
This is a decensored version of typhoon-ai/typhoon2.5-qwen3-30b-a3b, made using Heretic v1.1.0
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weight | 1.34 |
| attn.o_proj.max_weight_position | 28.51 |
| attn.o_proj.min_weight | 0.99 |
| attn.o_proj.min_weight_distance | 16.42 |
| mlp.down_proj.max_weight | 1.33 |
| mlp.down_proj.max_weight_position | 45.00 |
| mlp.down_proj.min_weight | 0.36 |
| mlp.down_proj.min_weight_distance | 16.47 |
Performance
| Metric | This model | Original model (typhoon-ai/typhoon2.5-qwen3-30b-a3b) |
|---|---|---|
| KL divergence | 0.1273 | 0 (by definition) |
| Refusals | 4/100 | 100/100 |
Enjoy mate 🧙🏻♂️!