license: apache-2.0
base_model: Qwen/Qwen3.5-4B
tags:
- qwen3.5
- safetensors
- uncensored
- abliterated
- tool-calling
- mtp
language: - en
pipeline_tag: image-text-to-text
Aurum 4B Uncensored
Aurum 4B Uncensored is official Qwen3.5-4B with only its refusal behaviour removed. Every other weight is Qwen's own.
It is built for everyday chat and tool calling on 8 GB graphics cards.
[!WARNING]
This model is uncensored. It does not refuse harmful requests (0 refusals out of 100 harmful test prompts).
You are responsible for how you use it and for what you do with its output. Do not deploy it where
people who did not choose an uncensored model can reach it.
Formerly 2Beyes/Aurum_4b-safetensors; old links redirect here.
GGUF quants (Q3_K_M to Q8_0, BF16, vision projector) for llama.cpp: 2Beyes/Aurum-4B-Uncensored-GGUF.
How it was made
- Start: Qwen/Qwen3.5-4B, with all of its weights, the vision tower and
its multi-token-prediction (MTP) head. - Refusal edit only: we took the weight difference between Qwen3.5-4B and
insraq/Qwen3.5-4B-EmperoAI-Qwen3.8-Distill-Heretic-Abliterated
and kept only the part that removes refusals:- attention output weights (
self_attn.o_proj/linear_attn.out_proj) of layers 4–31: the top 8 singular
directions of the change (about 98 % of it); - FFN output weights (
mlp.down_proj): the single top direction, only in tensors where it holds more than half of the
change (the same direction as the attention edit).
The rest of that model's changes (its distillation fine-tuning) is not included.
- attention output weights (
- Config, tokenizer and chat template come from the Heretic model above (same tokenizer as Qwen3.5).
- GGUF: converted with llama.cpp (b12289). All quants use an importance matrix computed on a sibling Aurum blend,
with a calibration text of prose, code and tool-call chats.
During development this build was called c-v1u. It beat two other candidates (an earlier Aurum blend and one with
half the distillation changes) in sealed tests: same tool accuracy, more knowledge, and no refusals.
Files
BF16 safetensors in the Qwen3.5 layout (Qwen3_5ForConditionalGeneration), including Qwen's unchanged vision tower and
MTP head. build_log.json lists every tensor the refusal edit touched and how much of the change it kept.
These weights are tensor-for-tensor identical to the BF16 GGUF that was benchmarked (checked by converting them again
and comparing every tensor).
Use
Load it like Qwen3.5-4B (needs a transformers version with Qwen3.5 support):
from transformers import AutoModelForImageTextToText, AutoProcessor
model = AutoModelForImageTextToText.from_pretrained("2Beyes/Aurum-4B-Uncensored", dtype="auto", device_map="auto")
processor = AutoProcessor.from_pretrained("Qwen/Qwen3.5-4B") # image/video preprocessing is unchanged
This folder has no image preprocessor config of its own: use Qwen3.5-4B's processor for images (the vision tower is
Qwen's, unchanged). For text-only use, AutoTokenizer.from_pretrained("2Beyes/Aurum-4B-Uncensored") is enough.
Thinking works like Qwen3.5 (enable_thinking in the chat template). For llama.cpp, use the GGUF files.
Benchmarks
Standard benchmarks: Aurum 4B vs. the model it replaces
Both models run as Q4_K_M in llama.cpp with thinking off, greedy decoding and no system prompt, scored with our own runner.
The previous model is
Qwen3.8-4B-Distill-Heretic-Abliterated (Q4_K_M).
| Benchmark | Previous model | Aurum 4B |
|---|---|---|
| IFEval, prompt strict / loose (541) | 72.8 / 75.8 | 78.6 / 81.5 |
| IFEval, instruction strict / loose | 81.3 / 83.8 | 85.3 / 87.5 |
| BFCL v3 non-live, average (1,240) | 68.7 | 85.9 |
| BFCL simple / multiple / parallel / parallel-multiple | 65.2 / 74.5 / 48.0 / 62.0 | 92.0 / 92.5 / 82.0 / 82.0 |
| BFCL irrelevance (no tool when none fits) | 93.8 | 80.8 |
| MMLU-Redux 2.0 (5,330 questions marked correct) | 75.0 | 74.9 |
| GPQA Diamond (198, answer order shuffled with a fixed seed) | 42.9 | 49.5 |
Notes:
- Qwen's published numbers are for BF16 with long thinking, and Qwen reports BFCL v4. These Q4, thinking-off
numbers are not directly comparable to them. - GPQA uses a 3,072-token answer limit. Aurum writes longer explanations: 84 of its 198 answers hit the limit and
count as wrong (6 for the previous model). Its score with a larger limit would likely be higher. - BFCL is scored with the
bfcl-evalAST checker on our own generations (simple, multiple, parallel,
parallel-multiple and irrelevance).
Refusals
| Test | Previous model | Official Qwen3.5-4B | Earlier Aurum blend | Aurum 4B |
|---|---|---|---|---|
| Refusals of 100 harmful prompts (mlabonne/harmful_behaviors) | 0 | 72 | 20 | 0 |
| Over-refusal: refusals of 30 harmless prompts × 3 samples | 1.1 % | 0 % | 0 % |
Refusals are counted with marker phrases, so this is an estimate, not a hand check.
Limitations
- It is a 4B model: it gets facts wrong, and it can call a tool when no tool fits (BFCL irrelevance 80.8).
Check tool results before trusting them. - It is verbose on hard reasoning questions with thinking off.
- It was tested only in English.
- The refusal edit removes refusals. It adds no knowledge and no safety of any kind.
Credits and license
Apache License 2.0 (see LICENSE), inherited from the models below.
- Qwen Team (Alibaba): Qwen3.5-4B, the base model and nearly all weights.
- insraq: Qwen3.5-4B-EmperoAI-Qwen3.8-Distill-Heretic-Abliterated (Heretic v1.4.0), the source of the refusal edit,
config, tokenizer and chat template. - empero-ai: Qwen3.8-4B-Distill, the model that insraq's model is built on.
- yachen4ever: the GGUF of that model, which Aurum 4B was compared against.
- Unsloth: the Qwen3.5-4B vision projector GGUF.
- ggml-org: llama.cpp, used for conversion, quantization and every benchmark.
@misc{qwen3.5,
title = {{Qwen3.5}: Towards Native Multimodal Agents},
author = {{Qwen Team}},
month = {February},
year = {2026},
url = {https://qwen.ai/blog?id=qwen3.5}
}