Get the app
← back to catalog · registered 2026-08-22 13:56

noctrex/Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE-GGUF

noctrex Qwen 35B GGUF MoE multimodal second-order 262K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/noctrex%2FQwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE-GGUF"
Response includes
  • classification m3
  • files 8
  • benchmarks 11 entries
  • hub_downloads_all_time 11,032
  • author_summary 44 models
  • readme_text full
Try next
GET/models?author=noctrex
All 44 models by noctrex
 GET/models?family=qwen&method=m3
Sibling qwen models · same method
 GET/methods/m3
What "m3" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
M1 Direct removal →
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
How we label → About M3 →
Refusal direction extracted via
Extraction technique

Difference-of-means

FromArditi et al. (2024) ↗
Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
What is a refusal direction? → Read the paper ↗
Downloads · lifetime
11K
868 last 30d - cooling
Likes
6
Model age
5mo ago
created 2026-05-03
Downloads over time
Now11.3K→from2.5K↑348%
2.1K5.5K8.8K12.2K2.5K on May 611.3K on Oct 11MayJunJulAugSepOct
May 6 → Oct 11 · 63 snapshots · spans 158 days

Benchmarks

Benchmark Score Source
Entertainment 1.9 UGI
Hazardous 2.4 UGI
Natural Intelligence 28.42 UGI
Political lean -12.5% UGI
Sensitive-Info 18.88 UGI
SocPol 1.5 UGI
UGI 44.25 UGI
Willingness (10) 9.5 UGI
W10-Adherence 9 UGI
W10-Direct 10 UGI
Writing 37.6 UGI

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

llmfan46/Qwen3.6-35B-A3B-uncensored-heretic↓ 1,279 this lineage
noctrex/Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE-GGUF↓ 868

Metadata

Quantizations
BF16 F16
Tags
gguf image-text-to-text base_model:llmfan46/Qwen3.6-35B-A3B-uncensored-heretic base_model:quantized:llmfan46/Qwen3.6-35B-A3B-uncensored-heretic endpoints_compatible region:us conversational

Related

Other by noctrex
Huihui-Qwen3-VL-4B-Instruct-abliterated-GGUF 28K Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF 15K Huihui-Qwen3-VL-8B-Instruct-abliterated-GGUF 9K gemma-4-26B-A4B-it-uncensored-heretic-MXFP4_MOE-GGUF 3K Huihui-Qwen3-VL-2B-Instruct-abliterated-GGUF 3K
Same base model
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF 29K mudler/Qwen3.6-35B-A3B-uncensored-heretic-APEX-GGUF 20K llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-NVFP4-Experts-Only-GGUF 17K mradermacher/Qwen3.6-35B-A3B-uncensored-heretic-i1-GGUF 12K froggeric/Qwen3.6-35B-A3B-Uncensored-Heretic-MLX-4bit 9K
Total size
60.0 GB
Files
8
Quantizations
4
Registered
2026-08-22 13:56
Last updated on HF
2026-05-03 23:20
Source huggingface.co/noctrex/Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE-GGUF ↗ Base model llmfan46/Qwen3.6-35B-A3B-uncensored-heretic →

Files by quantization

BF16 2 files 21.4 GB
Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE_BF16.gguf 20.5 GB 8f13da79 download
mmproj-BF16.gguf 861 MB 1c625f05 download
F16 2 files 21.4 GB
Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE_F16.gguf 20.5 GB 50019114 download
mmproj-F16.gguf 858 MB 67924785 download
F32 1 file 1.66 GB
mmproj-F32.gguf 1.66 GB 61aa2eb6 download
Auxiliary files 3 files 18.9 GB
Qwen3.6-35B-A3B-uncensored-heretic-MXFP4_MOE.gguf 18.9 GB f4aa7a78 download
.gitattributes 1.90 KB c5f46688 download
README.md 1.28 KB 0f8c9e1f download

README current version from Hugging Face

pipeline_tag: image-text-to-text
base_model:

  • llmfan46/Qwen3.6-35B-A3B-uncensored-heretic

These are MXFP4 quantizations of the model Qwen3.6-35B-A3B-uncensored-heretic

Quick Start

  1. Download the latest release of llama.cpp.
  2. Download your preferred model variant from below.
  3. For the mmproj file, it is recommended to use the F32 version for the best visual processing results. F32 > BF16 > F16

Which version should I choose?

All variants use MXFP4 for the MoE (Mixture of Experts) weights to keep the model efficient. The difference lies in how the remaining tensors are handled:

Variant Quality Performance Size Recommendation
BF16 ⭐⭐⭐ Variable* 20.55GiB Best for maximum accuracy; original unquantized weights.
F16 ⭐⭐ Fast 20.55GiB Great alternative if BF16 is slow on your hardware.
Q8 ⭐ Fastest 18.88GiB Balanced performance and memory usage.

Note: On some older architectures, BF16 may be slower than F16.
Check that your GPU supports native BF16

Read the guide from unsloth in order to set up the model's recommended settings:

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-05-03Add files using upload-large-folder tool72d55401.3 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration