← back to catalog · registered 2026-11-17 23:04

2Beyes/Aurum-4B-Uncensored-GGUF

2Beyes Qwen 4B GGUF multimodal
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/2Beyes%2FAurum-4B-Uncensored-GGUF"
Response includes
  • classification m8
  • files 14
  • benchmarks 11 entries
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
835
↑ 58% in 90 days
Likes
1
Model age
5d ago
created 2026-11-16
Downloads over time
Now 835 → from 528 ↑ 58%
409564720876 528 on Nov 17 835 on Nov 22 Nov
Nov 17 → Nov 22 · 6 snapshots · spans 5 days

Benchmarks

Portrait before abliteration
Benchmarks of the base model as it stood before the refusal-removal operation. Compare with the numbers above to see what the operation cost.
Benchmark Score Source
Entertainment 0.9 UGI
Hazardous 1.2 UGI
Natural Intelligence 13.45 UGI
Political lean -17.3% UGI
Sensitive-Info 11.73 UGI
SocPol 1.5 UGI
UGI 15.32 UGI
Willingness (10) 2.2 UGI
W10-Adherence 1.5 UGI
W10-Direct 3 UGI
Writing 29.68 UGI

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 17K downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
apache-2.0
Languages
en
Quantizations
BF16 IQ4 Q3_K Q4 Q4_K Q5_K Q6_K Q8_0
Tags
gguf qwen3.5 llama.cpp uncensored abliterated tool-calling mtp image-text-to-text en base_model:Qwen/Qwen3.5-4B base_model:quantized:Qwen/Qwen3.5-4B license:apache-2.0

Related

Control vectors

Total size
30.7 GB
Files
14
Quantizations
10
Registered
2026-11-17 23:04
Last updated on HF
2026-11-17 22:06

Files by quantization

BF16 1 file 8.07 GB
Aurum-4B-BF16.gguf 8.07 GB ca3cf1ea download
Q8_0 1 file 4.29 GB
Aurum-4B-Q8_0.gguf 4.29 GB 6fe23b9c download
Q6_K 1 file 3.32 GB
Aurum-4B-Q6_K.gguf 3.32 GB ccec732b download
Q5_K 1 file 2.94 GB
Aurum-4B-Q5_K_M.gguf 2.94 GB 9e8e713e download
Q4_K 2 files 5.04 GB
Aurum-4B-Q4_K_M.gguf 2.59 GB 9610bf59 download
Aurum-4B-Q4_K_S.gguf 2.45 GB 8bdabd82 download
Q4 1 file 2.44 GB
Aurum-4B-Q4_0.gguf 2.44 GB 8b73422c download
IQ4 1 file 2.40 GB
Aurum-4B-IQ4_XS.gguf 2.40 GB 11ddf2d1 download
Q3_K 1 file 2.16 GB
Aurum-4B-Q3_K_M.gguf 2.16 GB 8330d0da download
F16 1 file 641 MB
mmproj-Aurum-4B-F16.gguf 641 MB cd88edcf download
Auxiliary files 4 files 21.0 KB
LICENSE 11.1 KB d6456956 download
README.md 6.89 KB 4e695377 download
.gitattributes 2.04 KB a6da531d download
SHA256SUMS 1016 B 14a7d4b5 download

README current version from Hugging Face


license: apache-2.0
base_model: Qwen/Qwen3.5-4B
tags:

  • qwen3.5
  • gguf
  • llama.cpp
  • uncensored
  • abliterated
  • tool-calling
  • mtp
    language:
  • en
    pipeline_tag: image-text-to-text

Aurum 4B Uncensored (GGUF)

Aurum 4B Uncensored is official Qwen3.5-4B with only its refusal behaviour removed. Every other weight is Qwen's own.
It is built for everyday chat and tool calling on 8 GB graphics cards.

[!WARNING]
This model is uncensored. It does not refuse harmful requests (0 refusals out of 100 harmful test prompts).
You are responsible for how you use it and for what you do with its output. Do not deploy it where
people who did not choose an uncensored model can reach it.

Formerly 2Beyes/Aurum_4b; old links redirect here.

Full BF16 safetensors (for transformers, vLLM, fine-tuning and merging): 2Beyes/Aurum-4B-Uncensored.

How it was made

  1. Start: Qwen/Qwen3.5-4B, with all of its weights, the vision tower and
    its multi-token-prediction (MTP) head.
  2. Refusal edit only: we took the weight difference between Qwen3.5-4B and
    insraq/Qwen3.5-4B-EmperoAI-Qwen3.8-Distill-Heretic-Abliterated
    and kept only the part that removes refusals:
    • attention output weights (self_attn.o_proj / linear_attn.out_proj) of layers 4–31: the top 8 singular
      directions of the change (about 98 % of it);
    • FFN output weights (mlp.down_proj): the single top direction, only in tensors where it holds more than half of the
      change (the same direction as the attention edit).
      The rest of that model's changes (its distillation fine-tuning) is not included.
  3. Config, tokenizer and chat template come from the Heretic model above (same tokenizer as Qwen3.5).
  4. GGUF: converted with llama.cpp (b12289). All quants use an importance matrix computed on a sibling Aurum blend,
    with a calibration text of prose, code and tool-call chats.

During development this build was called c-v1u. It beat two other candidates (an earlier Aurum blend and one with
half the distillation changes) in sealed tests: same tool accuracy, more knowledge, and no refusals.

Files

Speed: RX 6600 8 GB, Vulkan, llama.cpp b12289, MTP drafting on (2 tokens), tokens per second.
KL divergence and "same top token" are measured against the BF16 model on a long-chat corpus (lower KL is better).

File Size KL vs BF16 Same top token Speed prose / code
Aurum-4B-BF16.gguf 8.7 GB 0 100 % (not measured)
Aurum-4B-Q8_0.gguf 4.6 GB 0.0028 98.6 % 47 / 64
Aurum-4B-Q6_K.gguf 3.6 GB 0.0067 97.2 % 48 / 67
Aurum-4B-Q5_K_M.gguf 3.2 GB 0.0111 96.2 % 57 / 76
Aurum-4B-Q4_K_M.gguf (recommended) 2.8 GB 0.0277 93.7 % 57 / 79
Aurum-4B-Q4_K_S.gguf 2.6 GB 0.0304 93.2 % 59 / 75
Aurum-4B-IQ4_XS.gguf 2.6 GB 0.0360 92.5 % 56 / 76
Aurum-4B-Q4_0.gguf 2.6 GB 0.0544 90.9 % 58 / 81
Aurum-4B-Q3_K_M.gguf 2.3 GB 0.0906 87.9 % 59 / 80
mmproj-Aurum-4B-F16.gguf 0.7 GB vision projector

The vision projector is Qwen3.5-4B's own vision tower (GGUF by Unsloth); Aurum does not change it.

Use with llama.cpp

llama-server -m Aurum-4B-Q4_K_M.gguf --mmproj mmproj-Aurum-4B-F16.gguf --jinja -c 16384 -ngl 999 \
  --spec-type draft-mtp --spec-draft-n-max 2
  • --jinja is needed for tool calls.
  • The MTP flags use the model's own prediction head to draft tokens: roughly 1.4x faster on code at the same output.
    On our card, drafts longer than 2 tokens were slower.
  • Thinking works like Qwen3.5 (enable_thinking in the chat template). The benchmarks below are with thinking off.

Benchmarks

Standard benchmarks: Aurum 4B vs. the model it replaces

Both models run as Q4_K_M in llama.cpp with thinking off, greedy decoding and no system prompt, scored with our own runner.
The previous model is
Qwen3.8-4B-Distill-Heretic-Abliterated (Q4_K_M).

Benchmark Previous model Aurum 4B
IFEval, prompt strict / loose (541) 72.8 / 75.8 78.6 / 81.5
IFEval, instruction strict / loose 81.3 / 83.8 85.3 / 87.5
BFCL v3 non-live, average (1,240) 68.7 85.9
BFCL simple / multiple / parallel / parallel-multiple 65.2 / 74.5 / 48.0 / 62.0 92.0 / 92.5 / 82.0 / 82.0
BFCL irrelevance (no tool when none fits) 93.8 80.8
MMLU-Redux 2.0 (5,330 questions marked correct) 75.0 74.9
GPQA Diamond (198, answer order shuffled with a fixed seed) 42.9 49.5

Notes:

  • Qwen's published numbers are for BF16 with long thinking, and Qwen reports BFCL v4. These Q4, thinking-off
    numbers are not directly comparable to them.
  • GPQA uses a 3,072-token answer limit. Aurum writes longer explanations: 84 of its 198 answers hit the limit and
    count as wrong (6 for the previous model). Its score with a larger limit would likely be higher.
  • BFCL is scored with the bfcl-eval AST checker on our own generations (simple, multiple, parallel,
    parallel-multiple and irrelevance).

Refusals

Test Previous model Official Qwen3.5-4B Earlier Aurum blend Aurum 4B
Refusals of 100 harmful prompts (mlabonne/harmful_behaviors) 0 72 20 0
Over-refusal: refusals of 30 harmless prompts × 3 samples 1.1 % 0 % 0 %

Refusals are counted with marker phrases, so this is an estimate, not a hand check.

Limitations

  • It is a 4B model: it gets facts wrong, and it can call a tool when no tool fits (BFCL irrelevance 80.8).
    Check tool results before trusting them.
  • It is verbose on hard reasoning questions with thinking off.
  • It was tested only in English.
  • The refusal edit removes refusals. It adds no knowledge and no safety of any kind.

Credits and license

Apache License 2.0 (see LICENSE), inherited from the models below.

  • Qwen Team (Alibaba): Qwen3.5-4B, the base model and nearly all weights.
  • insraq: Qwen3.5-4B-EmperoAI-Qwen3.8-Distill-Heretic-Abliterated (Heretic v1.4.0), the source of the refusal edit,
    config, tokenizer and chat template.
  • empero-ai: Qwen3.8-4B-Distill, the model that insraq's model is built on.
  • yachen4ever: the GGUF of that model, which Aurum 4B was compared against.
  • Unsloth: the Qwen3.5-4B vision projector GGUF.
  • ggml-org: llama.cpp, used for conversion, quantization and every benchmark.
@misc{qwen3.5,
    title  = {{Qwen3.5}: Towards Native Multimodal Agents},
    author = {{Qwen Team}},
    month  = {February},
    year   = {2026},
    url    = {https://qwen.ai/blog?id=qwen3.5}
}

README history 4 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-17 Rename to Aurum 4B Uncensored 0fd211d 6.7 KB
    Loading...
  2. 2026-11-17 Link the safetensors repo 77e5029 6.7 KB
    Loading...
  3. 2026-11-16 Aurum 4B GGUF 9097595 6.6 KB
    Loading...
  4. 2026-11-16 initial commit 4406708 28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration