license: apache-2.0
language:
- en
- zh
pipeline_tag: image-text-to-text
library_name: transformers
tags: - solstice-ai
- anvil
- gguf
- llama-cpp
- unsloth
- qwen3_8
- qwen3_6
- heretic
- uncensored
- cold-fusion
- gain-training
- multi-stage-tuning
- reasoning
- chain-of-thought
- token-efficient
- imatrix
base_model: DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU
model_name: Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored (GGUF Quants)
extra_gated_prompt: "This model is completely uncensored and de-aligned. You are solely responsible for outputs generated."
🌌 Qwen3.8-27B-TURBO-Fable-Cold-Fusion (Official GGUF Quants)
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored is an advanced frontier checkpoint combining GAIN Multi-Stage Post-Training, Cold-Fusion Weight Synthesis, Low-KLD Heretic De-alignment, and Precision Healing Datasets.
This repository provides the official dual-imatrix GGUF quantizations (including standard GGUF, Multi-Token Prediction MTP variants, and vision projection files mmproj), optimized for local inference across Anvil, llama.cpp, Ollama, and vLLM.
📊 Empirical Benchmarks vs. Base Qwen
The Stage 1b (735-882) post-heretic healing pipeline elevates core reasoning benchmarks 141 points above un-tuned Qwen 3.8-27B-Instruct while reducing reasoning token bloat by 2x to 10x:
| Model Checkpoint | ARC-C (0-shot) | ARC-E (0-shot) | BoolQ | HellaSwag | OpenBookQA | PIQA | WinoGrande |
|---|---|---|---|---|---|---|---|
| Qwen3.8-27B-TURBO-Fable (This Model) | 0.735 | 0.882 | 0.917 | 0.832 | 0.530 | 0.837 | 0.785 |
| Qwen3.8-27B-Instruct (Baseline Base) | 0.591 | 0.782 | 0.896 | 0.746 | 0.448 | 0.801 | 0.711 |
| Qwen3.6-27B-Instruct | 0.647 | 0.803 | 0.910 | 0.773 | 0.450 | 0.806 | 0.742 |
| Qwen3.6-35B-A3B-Instruct (MoE) | 0.581 | 0.757 | 0.892 | 0.751 | 0.428 | 0.803 | 0.688 |
| Qwen3.5-27B-Instruct | 0.557 | 0.711 | 0.868 | 0.533 | 0.452 | 0.706 | 0.695 |
📦 Quantization Matrix & Recommended Files
All GGUFs in this repository were calibrated with dual-importance matrix profiling (imatrix) to prevent precision degradation on reasoning heads:
| Quantization Type | File Size | Recommended VRAM | Quality / Use Case |
|---|---|---|---|
Q8_0 |
~28.8 GB | $\ge 32\text{ GB}$ | Near-lossless precision, ideal for complex architecture & formal math. |
Q6_K |
~22.6 GB | $\ge 24\text{ GB}$ | Sweet spot, preserves $>99.5%$ of 8-bit performance with high throughput. |
Q5_K_M |
~19.4 GB | $\ge 22\text{ GB}$ | Excellent balance for 24GB consumer GPUs (RTX 3090 / 4090). |
Q4_K_M |
~16.8 GB | $\ge 18\text{ GB}$ | Most popular, fits comfortably on 16GB–24GB GPUs with long context. |
IQ4_XS |
~15.2 GB | $\ge 16\text{ GB}$ | Advanced i-matrix quantization for tight 16GB VRAM budgets. |
IQ3_M / IQ2_M |
~11.8 GB / ~9.2 GB | $\ge 12\text{ GB}$ | Ultra-compact memory regimes for local consumer workstations. |
mmproj-BF16.gguf |
~1.2 GB | - | Required for vision/multimodal features in llama.cpp / Anvil. |
🚀 Quickstart Guide
1. Run with llama.cpp CLI
# Text Reasoning Mode
./llama-cli \
-m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
-p "<|im_start|>user\nProvide a comprehensive analysis of dual-plane imatrix modulation.<|im_end|>\n<|im_start|>assistant\n<think>\n" \
-n 2048 \
--temp 0.7 \
-ngl 99
# Multimodal Vision Mode (with mmproj)
./llama-cli \
-m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
--mmproj mmproj-BF16.gguf \
--image diagram.png \
-p "Describe the architectural flow in this image."
2. Launch Local OpenAI-Compatible Server
./llama-server \
-m Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf \
--host 0.0.0.0 \
--port 8080 \
-c 32768 \
-ngl 99
3. Run with Ollama
Create a Modelfile:
FROM ./Qwen3.8-27B-TurboFCFusion-735-882-Here-Uncen-NEO-CODER-MAX-Q4_K_M.gguf
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ if .Thinking }}<think>
{{ .Thinking }}
</think>
{{ end }}{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|endoftext|>"
Then create and run:
ollama create qwen3.8-turbo-fable -f Modelfile
ollama run qwen3.8-turbo-fable
📜 Attribution & Lineage
- Base Model Architecture:
Qwen/Qwen3.8-27B - Fine-Tuning & Multi-Stage GAIN: DavidAU & Nightmedia
- GGUF Quantization & Distribution: Solstice-AI
- License: Apache 2.0
@misc{solstice2026qwen38turbogguf,
title={Qwen3.8-27B-TURBO-Fable-Cold-Fusion: Dual-imatrix GGUF Quantizations for Frontier Local Reasoning},
author={Solstice-AI Research and DavidAU and Nightmedia},
year={2026},
publisher={Hugging Face},
howpublished={\url{https://huggingface.co/Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-GGUF}}
}