← back to catalog · registered 2026-09-02 15:03

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised

Solstice-AI 27B GGUF multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Solstice-AI%2FQwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF-UltraOptimised"
Response includes
  • classification m3
  • files 21
  • author_summary 73 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · 30-day
6K
Likes
6
Model age
7w ago
created 2026-09-02
Downloads over time
Now6K→from0↑0%
02.2K4.4K6.6K0 on Sep 26K on Sep 7Sep
Sep 2 → Sep 7 · 6 snapshots · spans 5 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en zh
Quantizations
IQ4 Q4_K Q5_K Q6_K Q8_0
Tags
gguf solstice-ai davidau davidau-quants qwen qwen3.8 qwen3.8-27b cold-fusion gain project-heretic heretic uncensored

Related

Total size
308 GB
Files
21
Quantizations
7
Registered
2026-09-02 15:03
Last updated on HF
2026-09-07 09:37

Files by quantization

Q8_0 2 files 55.9 GB
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q8_0.gguf 28.2 GB 54f27515 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q8_0.gguf 27.7 GB 0c87ce4c download
Q6_K 2 files 44.3 GB
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q6_K.gguf 22.4 GB ac011aab download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q6_K.gguf 22.0 GB f814af8d download
Q5_K 4 files 77.0 GB
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q5_K_M.gguf 19.7 GB 7408f594 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q5_K_M.gguf 19.3 GB 4132d28c download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q5_K_S.gguf 19.2 GB 89d30692 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q5_K_S.gguf 18.8 GB d9baa706 download
Q4_K 4 files 66.3 GB
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q4_K_M.gguf 17.2 GB bc7a6cf2 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf 16.8 GB cf35a030 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-Q4_K_S.gguf 16.3 GB 889caf99 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_S.gguf 15.9 GB 208ec01c download
IQ4 4 files 64.0 GB
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-IQ4_NL.gguf 16.5 GB ddc96e4a download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-IQ4_NL.gguf 16.1 GB 02a2ad9e download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-MTP-IQ4_XS.gguf 15.9 GB 318d14f8 download
Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-IQ4_XS.gguf 15.4 GB b7f7f75d download
BF16 1 file 888 MB
mmproj-BF16.gguf 888 MB b0d8d89e download
Auxiliary files 4 files 3.42 MB
star-wars-hans-solo.gif 3.35 MB b977bb1e download
qwen38-27b-turbo-tfcf735.png 60.0 KB e72ff6f8 download
README.md 5.82 KB ab4ec8fa download
.gitattributes 4.04 KB f8c48510 download

README current version from Hugging Face


license: apache-2.0
language:

  • en
  • zh
    pipeline_tag: image-text-to-text
    library_name: transformers
    tags:
  • solstice-ai
  • anvil
  • gguf
  • llama-cpp
  • unsloth
  • qwen3_8
  • qwen3_6
  • heretic
  • uncensored
  • cold-fusion
  • gain-training
  • multi-stage-tuning
  • reasoning
  • chain-of-thought
  • token-efficient
  • imatrix
    base_model: DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU
    model_name: Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored (GGUF Quants)
    extra_gated_prompt: "This model is completely uncensored and de-aligned. You are solely responsible for outputs generated."

🌌 Qwen3.8-27B-TURBO-Fable-Cold-Fusion (Official GGUF Quants)

Solstice-AI Anvil Runtime DavidAU

Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored is an advanced frontier checkpoint combining GAIN Multi-Stage Post-Training, Cold-Fusion Weight Synthesis, Low-KLD Heretic De-alignment, and Precision Healing Datasets.

This repository provides the official dual-imatrix GGUF quantizations (including standard GGUF, Multi-Token Prediction MTP variants, and vision projection files mmproj), optimized for local inference across Anvil, llama.cpp, Ollama, and vLLM.


📊 Empirical Benchmarks vs. Base Qwen

The Stage 1b (735-882) post-heretic healing pipeline elevates core reasoning benchmarks 141 points above un-tuned Qwen 3.8-27B-Instruct while reducing reasoning token bloat by 2x to 10x:

Model Checkpoint ARC-C (0-shot) ARC-E (0-shot) BoolQ HellaSwag OpenBookQA PIQA WinoGrande
Qwen3.8-27B-TURBO-Fable (This Model) 0.735 0.882 0.917 0.832 0.530 0.837 0.785
Qwen3.8-27B-Instruct (Baseline Base) 0.591 0.782 0.896 0.746 0.448 0.801 0.711
Qwen3.6-27B-Instruct 0.647 0.803 0.910 0.773 0.450 0.806 0.742
Qwen3.6-35B-A3B-Instruct (MoE) 0.581 0.757 0.892 0.751 0.428 0.803 0.688
Qwen3.5-27B-Instruct 0.557 0.711 0.868 0.533 0.452 0.706 0.695

📦 Quantization Matrix & Recommended Files

All GGUFs in this repository were calibrated with dual-importance matrix profiling (imatrix) to prevent precision degradation on reasoning heads:

Quantization Type File Size Recommended VRAM Quality / Use Case
Q8_0 ~28.8 GB $\ge 32\text{ GB}$ Near-lossless precision, ideal for complex architecture & formal math.
Q6_K ~22.6 GB $\ge 24\text{ GB}$ Sweet spot, preserves $>99.5%$ of 8-bit performance with high throughput.
Q5_K_M ~19.4 GB $\ge 22\text{ GB}$ Excellent balance for 24GB consumer GPUs (RTX 3090 / 4090).
Q4_K_M ~16.8 GB $\ge 18\text{ GB}$ Most popular, fits comfortably on 16GB–24GB GPUs with long context.
IQ4_XS ~15.2 GB $\ge 16\text{ GB}$ Advanced i-matrix quantization for tight 16GB VRAM budgets.
IQ3_M / IQ2_M ~11.8 GB / ~9.2 GB $\ge 12\text{ GB}$ Ultra-compact memory regimes for local consumer workstations.
mmproj-BF16.gguf ~1.2 GB - Required for vision/multimodal features in llama.cpp / Anvil.

🚀 Quickstart Guide

1. Run with llama.cpp CLI

# Text Reasoning Mode
./llama-cli \
  -m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
  -p "<|im_start|>user\nProvide a comprehensive analysis of dual-plane imatrix modulation.<|im_end|>\n<|im_start|>assistant\n<think>\n" \
  -n 2048 \
  --temp 0.7 \
  -ngl 99

# Multimodal Vision Mode (with mmproj)
./llama-cli \
  -m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
  --mmproj mmproj-BF16.gguf \
  --image diagram.png \
  -p "Describe the architectural flow in this image."

2. Launch Local OpenAI-Compatible Server

./llama-server \
  -m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
  --host 0.0.0.0 \
  --port 8080 \
  -c 32768 \
  -ngl 99

3. Run with Ollama

Create a Modelfile:

FROM ./Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ if .Thinking }}<think>
{{ .Thinking }}
</think>
{{ end }}{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|endoftext|>"

Then create and run:

ollama create qwen3.8-turbo-fable -f Modelfile
ollama run qwen3.8-turbo-fable

📜 Attribution & Lineage

  • Base Model Architecture: Qwen/Qwen3.8-27B
  • Fine-Tuning & Multi-Stage GAIN: DavidAU & Nightmedia
  • GGUF Quantization & Distribution: Solstice-AI
  • License: Apache 2.0
@misc{solstice2026qwen38turbogguf,
  title={Qwen3.8-27B-TURBO-Fable-Cold-Fusion: Dual-imatrix GGUF Quantizations for Frontier Local Reasoning},
  author={Solstice-AI Research and DavidAU and Nightmedia},
  year={2026},
  publisher={Hugging Face},
  howpublished={\url{https://huggingface.co/Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF}}
}

README history 19 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-09-08Update README.md267338a14 KB
    Loading...
  2. 2026-09-08Update README.mde5eec6d14 KB
    Loading...
  3. 2026-09-08Update README.mdc3b57ae13.9 KB
    Loading...
  4. 2026-09-08Update README.mdf2fcba713.9 KB
    Loading...
  5. 2026-09-08Update README.mdcf180cc13.9 KB
    Loading...
  6. 2026-09-08Update README.mdc07f8e014.3 KB
    Loading...
  7. 2026-09-07docs: add companion DSpark drafters and llama.cpp speculative decoding recipes006443f14.3 KB
    Loading...
  8. 2026-09-03docs: update chat template with <think> reasoning tokens, tool calling, and l...9e1207113 KB
    Loading...
  9. 2026-09-03docs: update KV cache to 4-bit (-ctk q4_0 -ctv q4_0) for maximum context effi...d3a791910.9 KB
    Loading...
  10. 2026-09-03docs: add llama.cpp -fa -ctk q8_0 -ctv q8_0 cache compression and Anvil Turbo...3d3f7af10.9 KB
    Loading...
  11. 2026-09-03docs: update llama.cpp flags to --hf-repo/--hf-file and replace deprecated cli7991a1210.8 KB
    Loading...
  12. 2026-09-03docs: replace deprecated huggingface-cli with modern hf downloada8d121c10.9 KB
    Loading...
  13. 2026-09-03docs: 3x expanded model card with full quant matrix, verified filenames, Anvi...5107bfb10.8 KB
    Loading...
  14. 2026-09-02docs: extensive marketing documentation, DavidAU co-branding, Opus 4.6 teleme...7aa8f048.3 KB
    Loading...
  15. 2026-09-02docs: extensive marketing documentation, DavidAU co-branding, Opus 4.6 teleme...2799d467.6 KB
    Loading...
  16. 2026-09-02docs: highlight verified benchmark dominance over Claude Opus 4.6 Max across ...82da4105.5 KB
    Loading...
  17. 2026-09-02Upload README.md with huggingface_hub364d46f4.6 KB
    Loading...
  18. 2026-09-02docs: add official GGUF model card with benchmarks, VRAM sizing, and llama.cp...87497415.8 KB
    Loading...
  19. 2026-09-02Copy files from models/DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-He...4756c39379.4 KB
    Loading...

Discussions 2 threads

  1. 2026-10-18Can you upload the safetensors for this model so we can quantize for vLLM / SGL…open2 💬#2
    Loading...
  2. 2026-09-10MLXopen8 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration