← back to catalog · registered 2026-11-20 22:04

esatapedico/Qwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET-GGUF

esatapedico 27B GGUF second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/esatapedico%2FQwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET-GGUF"
Response includes
  • classification m3
  • files 4
  • author_summary 16 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · 30-day
196
Likes
0
Model age
1d ago
created 2026-11-20
Downloads over time
Now 196 → from 0 ↑ 0%
072144216 0 on Nov 20 196 on Nov 22 Nov
Nov 20 → Nov 22 · 3 snapshots · spans 2 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en multilingual
Tags
gguf nvfp4 qwen3.8 blackwell ultimate-heretic llama.cpp text-generation en multilingual base_model:DavidAU/Qwen3.8-27B-Ultimate-Heretic-Uncensored base_model:quantized:DavidAU/Qwen3.8-27B-Ultimate-Heretic-Uncensored license:apache-2.0

Related

Total size
27.3 GB
Files
4
Quantizations
1
Registered
2026-11-20 22:04
Last updated on HF
2026-11-20 21:56

Files by quantization

Auxiliary files 4 files 27.3 GB
Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET.gguf 13.7 GB 6b04d202 download
Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-STARVED.gguf 13.6 GB 7b79c749 download
README.md 8.30 KB ab3f0abf download
.gitattributes 1.70 KB fcd4c6c9 download

README current version from Hugging Face


license: apache-2.0
base_model: DavidAU/Qwen3.8-27B-Ultimate-Heretic-Uncensored
pipeline_tag: text-generation
library_name: gguf
description: "Two compact no-MTP GGUFs of DavidAU's Ultimate-Heretic Turbo-Brilliance-50x-AGI-NEO tune of Qwen3.8-27B (NVFP4): BUDGET (Q3_K lm_head) and STARVED (Q2_K everything). Byte-identical 448-tensor NVFP4 backbone, no MTP head, single-16GB friendly. Blackwell sm_120."
tags:

  • gguf
  • nvfp4
  • qwen3.8
  • blackwell
  • ultimate-heretic
  • llama.cpp
    language:
  • en
  • multilingual

Qwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET-GGUF

Two compact GGUF files of DavidAU/Qwen3.8-27B-Ultimate-Heretic-Uncensored, DavidAU's Ultimate-Heretic Turbo-Brilliance-50x-AGI-NEO tune of Qwen3.8-27B — without the MTP speculative head.

HF repo: esatapedico/Qwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET-GGUF

These are the budget members of the esatapedico/Qwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-MTP-GGUF family: they share the same byte-identical 448-tensor NVFP4 backbone as the seven MTP tiers, but the MTP draft block has been stripped and the extra tensors pinned to the smallest types. No drafter, no speculative decoding — just the model at the lowest possible footprint.

The goal here is to let 16 GB VRAM users benefit from native NVFP4. These are the smallest possible ways to serve this tune on a single 16 GB Blackwell card. There are, of course, accuracy trade-offs vs the larger tiers, plus the lack of MTP.

  • BUDGET — the quality-leaning budget tier: Q3_K lm_head + Q2_K token embedding. Single-16GB friendly.
  • STARVED — the absolute floor: Q2_K lm_head and Q2_K token embedding. Smallest possible variant of the family.

Follow along & support

I post updates on new conversions, benchmarks, and what I'm working on over on my site. Follow along there to keep up with new releases and the work in progress. If you'd like to support more of it, you will find the options there. I do this on consumer hardware and like seeing how far it goes. More is on the way.

🌐 esatapedico.com. Updates, work-in-progress, and ways to support.

The two files

File Size lm_head (output.weight) token_embd MTP head SHA-256
Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET.gguf 14,723,056,960 bytes (14.72 GB) Q3_K Q2_K — (none) 6b04d202f1583a4384ae3c610699e624827685a18ff280fac9e4779b063adb12
Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-STARVED.gguf 14,593,930,496 bytes (14.59 GB) Q2_K Q2_K — (none) 7b79c749b95b9b91f6a77c6c313c92325bfc1d35d29348e3bb053faec20310dc

Both contain 1,107 tensors: the 448-tensor NVFP4 backbone (byte-identical with the seven MTP tiers, verified per-tensor SHA-256) + 657 F32 norms/scales + the two head tensors. qwen35.nextn_predict_layers=0 and qwen35.block_count=64 (the MTP block is gone), so they load in any llama.cpp build without the draft-mtp path.

Why these exist

The MTP family is built around a byte-identical NVFP4 backbone; the MTP draft head costs VRAM and compute on every pass. If you don't use speculative decoding, the stripped versions free that head entirely and shave the extra tensors down to the cheapest types — the smallest possible way to serve this tune on a single 16 GB Blackwell card.

Vision works. Pair either GGUF with the mmproj-BF16.gguf (b02e6393f72a69e2358388fbeffddc52b04898933a15d44de9ff3eb08f6099e0, 927,608,768 bytes) from the MTP repo via --mmproj. If you need the absolute minimum VRAM footprint on a single 16 GB card, you can also load the model without the projector (no --mmproj, i.e. text-only) — that frees the projector's ~1 GB and is another lever to fit bigger context.

Measurements

Single-turn smoke: both files generate coherent text with a natural stop and no repetition-loop signature (BUDGET 27.9 t/s decode, STARVED 30.4 t/s).

Perplexity on a source-diverse corpus (lower is better):

Tier PPL
BUDGET 3.3414±0.07566
STARVED 3.5139±0.08154

BUDGET matches its VERY-LOW parent to the digit, as expected — stripping the unused MTP block changes nothing the perplexity pass reads.

Task quality (unified suite gate)

MMLU letter-logprob subset e1aee941… (n=1000, thinking off) and GSM8K (n=200, thinking on), same flags as the seven-tier ladder:

Tier MMLU (n=1000) GSM8K (n=200)
BUDGET 83.29% 0.93
STARVED 82.42% 0.935

BUDGET reproduces its VERY-LOW parent exactly. Every suite verdict FAILs only on the absent KLD anchor, as with the MTP tiers.

Usage

llama.cpp / llama-server

llama-server \
  --model Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET.gguf \
  --mmproj mmproj-BF16.gguf \
  --ctx-size 131072 \
  --flash-attn on \
  --temp 0.7 --top-p 0.95 --top-k 20
  • Requires a recent llama.cpp with NVFP4 (GGML type 40) CUDA kernels and Blackwell support.
  • No --spec-type draft-mtp — these files have no MTP head.
  • For vision input, add --mmproj mmproj-BF16.gguf (from the MTP repo).

Attribution & provenance

This is a derivative work built entirely from existing Apache-2.0 artifacts. Nothing here was trained or fine-tuned. This work covers the numeric conversion only and makes no ownership claims over the model. Credit belongs to:

  1. Alibaba / Qwen team for the base model family (Apache-2.0): the 27B dense hybrid architecture this tune builds on.
  2. DavidAU for the tune itself, Qwen3.8-27B-Ultimate-Heretic-Uncensored (Apache-2.0), including the Turbo-Brilliance-50x-AGI-NEO system these files are named for.
  3. This repo's author for the NVFP4 conversion, the tier ladder, and stripping the MTP head.

Source provenance: stripped from revision 89cbc521c61a5043a15f6154fab856daad818edc of the upstream tune (November 16 upstream refresh, Heretic 2.1 ARA), via the same 448-tensor NVFP4 backbone as the MTP ladder.

Changelog

  • 2026-11-20: initial release, stripped from the revised-source ladder with strip_mtp.py (plus a one-line fix in the script to also trim the trailing entry of per-block metadata arrays such as qwen35.attention.recurrent_layers, without which llama.cpp rejects the files). BUDGET task figures were measured on the byte-identical-tensor fixed-script build; the shipped file is its deterministic rebuild (metadata-only SHA delta, tensor bytes identical, backbone re-verified 36/36 against all nine staged files).

Repository contents

  • Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET.gguf (14.72 GB)
  • Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-STARVED.gguf (14.59 GB)

SHA-256

6b04d202f1583a4384ae3c610699e624827685a18ff280fac9e4779b063adb12  Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-BUDGET.gguf
7b79c749b95b9b91f6a77c6c313c92325bfc1d35d29348e3bb053faec20310dc  Qwen3.8-27B-Ultimate-Heretic-Turbo-Brilliance-50x-AGI-NEO-NVFP4-STARVED.gguf

See also

The full MTP family (ORIG + seven tiers VERY-LOW through VERY-HIGH, all with the speculative head baked in, plus mmproj-BF16.gguf) lives in esatapedico/Qwen3.8-27B-Ultimate-Heretic-Uncensored-Turbo-Brilliance-50x-AGI-NEO-NVFP4-MTP-GGUF.

License

Apache-2.0, identical to every upstream artifact. The base model license governs. GGUF conversion and quantization are transformations, not new training. When redistributing, please retain attribution to Qwen (Alibaba) and DavidAU as above.

"Qwen" is a trademark of Alibaba. Trademarks are used here only to identify upstream models. This repository is not affiliated with, sponsored by, or endorsed by Alibaba or DavidAU.

Card written with AI assistance.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-20 Upload README.md with huggingface_hub db2e959 8.3 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration