license: apache-2.0
base_model: DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU
pipeline_tag: text-generation
library_name: gguf
description: "Two compact no-MTP GGUFs of DavidAU Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU (TURBO Fable Cold Fusion Heretic Uncensored, 735/882): BUDGET (Q3_K lm_head) and STARVED (Q2_K everything). Byte-identical 448-tensor native NVFP4 backbone, no MTP head, single-16GB friendly. 262,144 native context. Blackwell sm_120."
tags:
- gguf
- nvfp4
- qwen3.8
- qwen3.5
- blackwell
- vision
- multimodal
- llama.cpp
- turbo
- fable
- cold-fusion
language: - en
- multilingual
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-BUDGET-GGUF
Two compact GGUF files of DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU (TURBO Fable Cold Fusion Heretic Uncensored, 735/882 Heretic merge and DPO layers on Qwen3.8-27B, 27B dense hybrid with Gated DeltaNet plus Gated Attention, 262,144-token native context, native vision tower) - without the MTP speculative head.
These are the budget members of the esatapedico/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-GGUF family: they share the same byte-identical 448-tensor native NVFP4 backbone (all 64 layers attention plus MLP, 13.69 GB of NVFP4) as the MTP tiers, but the MTP draft block has been stripped and the extra tensors pinned to the smallest types. No drafter, no speculative decoding, just the model at the lowest possible footprint. Pairs with the original Qwen3.8 vision projector.
The goal is to let 16 GB VRAM users benefit from native NVFP4. These are the smallest possible ways to serve this TURBO tune on a single 16 GB Blackwell card. There are, of course, accuracy trade-offs vs the larger MTP tiers, plus the lack of MTP. Like every compact tier of the family, the NVFP4 backbone is preserved byte identical, and here the head tensors are pinned to the smallest types. You can also fit TURBO 735-882 in 16 GB through non-NVFP4 variants if you prefer a different quantization.
BUDGET- the quality-leaning budget tier:Q3_Klm_head plusQ2_Ktoken embedding. Single-16GB friendly.STARVED- the absolute floor:Q2_Klm_head andQ2_Ktoken embedding. Smallest possible variant of the family.
Follow along & support
I post updates on new conversions, benchmarks, and what I am working on over on Ko-fi. Follow along there to keep up with new releases and the work in progress. If you would like to support more of it, a coffee is always welcome. I do this on consumer hardware and like seeing how far it goes. More is on the way.
☕ ko-fi.com/esatapedico. Updates, work-in-progress, and an optional coffee.
The two files
| File | Size | lm_head (output.weight) |
token_embd | MTP head |
|---|---|---|---|---|
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-BUDGET.gguf |
14.72 GB | Q3_K |
Q2_K |
- (none) |
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-STARVED.gguf |
14.59 GB | Q2_K |
Q2_K |
- (none) |
Both contain 1,107 tensors: the 448-tensor native NVFP4 backbone (byte-identical across the whole TURBO family, verified per-tensor SHA-256) plus 657 F32 norms/scales/gates plus the two head tensors. qwen35.nextn_predict_layers=0 and qwen35.block_count=64 (the MTP block is gone), so they load in any llama.cpp build without the draft-mtp path.
Why these exist
The MTP family is built around a byte-identical NVFP4 backbone; the MTP draft head costs VRAM and compute on every pass. If you do not use speculative decoding, the stripped versions free that head entirely and shave the extra tensors down to the cheapest types - the smallest possible way to serve this TURBO tune on a single 16 GB Blackwell card.
Vision works. The TURBO 735-882 tune leaves the original Qwen3.8 vision tower untouched. Pair either GGUF with the mmproj-BF16.gguf from the MTP repo or the base model DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU / unsloth/Qwen3.8-27B-GGUF projector via --mmproj. If you need the absolute minimum VRAM footprint on a single 16 GB card, you can also load the model without the projector (no --mmproj, i.e. text-only) - that frees the projector's about 1 GB and is another lever to fit bigger context.
Usage
llama.cpp / llama-server
llama-server \
--model Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-BUDGET.gguf \
--mmproj mmproj-BF16.gguf \
--ctx-size 262144 \
--flash-attn on \
--temp 0.7 --top-p 0.95 --top-k 20
- Requires a recent llama.cpp with NVFP4 (GGML type 40) CUDA kernels and
sm_120support (Blackwell). - No
--spec-type draft-mtp- these files have no MTP head. - For vision input, pass
--mmproj mmproj-BF16.gguf(from the MTP repo or base). - Qwen3.8 official sampling presets: thinking mode
temp 1.0 / top_p 0.95 / top_k 20; instruct modetemp 0.7 / top_p 0.80 / top_k 20. Pick per use case.
Attribution & provenance
This is a derivative work built entirely from existing Apache-2.0 artifacts. Nothing here was trained or fine-tuned. Credit belongs to:
- Alibaba / Qwen team for the base model, Qwen/Qwen3.8-27B (Apache-2.0).
- DavidAU for the tune itself, DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU (Apache-2.0): the TURBO 735-882 Fable plus Cold Fusion plus Heretic/Uncensored DPO stack.
- Unsloth for the NVFP4 quantization approach and the vision projector unsloth/Qwen3.8-27B-GGUF (Apache-2.0,
mmproj-BF16.gguf). - This repo's author for the GGUF conversion, the tier splicing, and stripping the MTP head.
The NVFP4 tensors are native GGML type 40, preserved from the source checkpoint through GGUF conversion with no re-quantization round trip.
Repository contents
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-BUDGET.gguf(14.72 GB)Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-STARVED.gguf(14.59 GB)
SHA-256
b938c42d0d5f5c85641360c28bfece301eb8179f2b29ff1d31728095e9e19132 Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-BUDGET.gguf
6a050fc09f565c54eab8336d070b4e5e4ff0a3f92fa2cd1d5ae290b389a9c10d Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-STARVED.gguf
See also
The full MTP family (VERY-LOW / LOW / MEDIUM / MID-HIGH / HIGH / VERY-HIGH / HIGHEST, all with the speculative head baked in) lives in esatapedico/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-NVFP4-GGUF. The budget tiers share its byte-identical 448-tensor NVFP4 backbone with the MTP block removed.
License
Apache-2.0, identical to every upstream artifact. The base model license governs; GGUF conversion and quantization are transformations, not new training. When redistributing, please retain attribution to Qwen (Alibaba), DavidAU, and Unsloth as above.
"Qwen" is a trademark of Alibaba. Trademarks are used here only to identify upstream models; this repository is not affiliated with, sponsored by, or endorsed by Alibaba, DavidAU, or Unsloth.
Note on this card
This model card was written by an AI assistant at the request of the repository author, who did the engineering. As with any AI-generated text, there may be errors; please verify anything important (hashes, sizes, commands) against the file itself before relying on it.