← back to catalog · registered 2026-09-02 13:03

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit

Solstice-AI 27B multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Solstice-AI%2FQwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit"
Response includes
  • classification m3
  • files 13
  • hub_downloads_all_time 2,669
  • author_summary 73 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · lifetime
3K
1K last 30d - stable
Likes
2
Model age
6w ago
created 2026-09-02
Downloads over time
Now3.3K→from0↑0%
01.2K2.4K3.6K0 on Sep 23.3K on Oct 20SepOct
Sep 2 → Oct 20 · 49 snapshots · spans 48 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en zh
Tags
mlx safetensors qwen3_5 solstice-ai davidau davidau-quants qwen qwen3.8 qwen3.8-27b cold-fusion gain project-heretic

Related

Total size
20.4 GB
Files
13
Quantizations
1
Registered
2026-09-02 13:03
Last updated on HF
2026-10-15 02:53

Files by quantization

Auxiliary files 13 files 20.4 GB
model-00001-of-00005.safetensors 5.00 GB 416c2cf5 download
model-00002-of-00005.safetensors 4.98 GB be6b3019 download
model-00003-of-00005.safetensors 4.97 GB d72c8b96 download
model-00004-of-00005.safetensors 4.45 GB 60e632dd download
model-00005-of-00005.safetensors 985 MB 0c6841a0 download
tokenizer.json 19.1 MB 87a7830d download
model.safetensors.index.json 185 KB 833de0b9 download
chat_template.jinja 8.74 KB 5a39aa2b download
README.md 5.91 KB 3923e456 download
config.json 4.14 KB 0b8e244e download
.gitattributes 1.53 KB 52373fe2 download
tokenizer_config.json 1.20 KB 7b4fe305 download
generation_config.json 213 B d04042de download

README current version from Hugging Face


license: apache-2.0
language:

  • en
  • zh
    pipeline_tag: image-text-to-text
    library_name: transformers
    tags:
  • solstice-ai
  • anvil
  • mlx
  • mlx-my-repo
  • 6-bit
  • qwen3_8
  • qwen3_6
  • heretic
  • uncensored
  • cold-fusion
  • gain-training
  • multi-stage-tuning
  • reasoning
  • chain-of-thought
  • token-efficient
    base_model: DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU
    model_name: Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored (MLX 6-Bit)
    extra_gated_prompt: "This model is completely uncensored and de-aligned. You are solely responsible for outputs generated."

🌌 Qwen3.8-27B-TURBO-Fable-Cold-Fusion (6-Bit MLX)

Solstice-AI Anvil Runtime DavidAU

Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored is an advanced frontier checkpoint combining GAIN Multi-Stage Post-Training, Cold-Fusion Weight Synthesis, Low-KLD Heretic De-alignment, and Precision Healing Datasets.

This repository provides the official 6-Bit Apple Silicon MLX quantization, delivering 99% of 8-bit cognitive performance with an ultra-compact memory footprint of ~22.4 GB VRAM, enabling full-speed local execution on Apple M-Series Silicon (M2/M3/M4 Pro, Max, and Ultra).


📊 Empirical Benchmarks vs. Base Qwen

The Stage 1b (735-882) post-heretic healing pipeline elevates core reasoning benchmarks 141 points above un-tuned Qwen 3.8-27B-Instruct while reducing reasoning token bloat by 2x to 10x:

Model Checkpoint ARC-C (0-shot) ARC-E (0-shot) BoolQ HellaSwag OpenBookQA PIQA WinoGrande
Qwen3.8-27B-TURBO-Fable (This Model, 6-Bit) 0.735 0.882 0.917 0.832 0.530 0.837 0.785
Qwen3.8-27B-Instruct (Baseline Base) 0.591 0.782 0.896 0.746 0.448 0.801 0.711
Qwen3.6-27B-Instruct 0.647 0.803 0.910 0.773 0.450 0.806 0.742
Qwen3.6-35B-A3B-Instruct (MoE) 0.581 0.757 0.892 0.751 0.428 0.803 0.688
Qwen3.5-27B-Instruct 0.557 0.711 0.868 0.533 0.452 0.706 0.695

Key Takeaways:

  • +14.4% ARC-Challenge jump over stock Qwen 3.8-27B-Instruct.
  • +8.6% HellaSwag reasoning gain and +7.4% WinoGrande commonsense gain.
  • Zero Alignment Degradation: Heretic decensoring executed with ultra-low KL-Divergence ($\text{KLD} = 0.0025$), followed by precision healing datasets.

⚡ Architecture & Training Highlights

  1. Multi-Stage GAIN Training: Multi-phase post-training aligning synthetic frontier reasoning traces without catastrophic forgetting.
  2. Dynamic Thinking & Token Efficiency: Automatically modulates <thinking> chain-of-thought length based on prompt complexity (allocating deep scratchpads for hard math/code and direct responses for concise queries).
  3. True Uncensored Capability: Complete removal of refusal vectors and corporate safety boilerplate, enabling unrestricted security research, red-teaming, and creative writing.
  4. Asymmetric MLX 6-Bit Quantization: Quantized with fused scale factors preserving critical attention projection layers in high precision.

🚀 Quickstart Guide

1. Run with mlx-lm (Python)

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit")

prompt = "Analyze the asymptotic memory complexity of Fast Walsh-Hadamard KV cache compression."

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)

response = generate(
    model, 
    tokenizer, 
    prompt=prompt, 
    max_tokens=2048, 
    temp=0.7, 
    verbose=True
)

2. Local CLI Interactive Chat

mlx_lm.chat --model Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit

3. Launch OpenAI-Compatible Local Server

mlx_lm.server --model Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit --port 8080

💻 Hardware & Memory Requirements

Apple Silicon Chip Unified Memory Generation Speed Status
M2 / M3 / M4 Max (36GB - 64GB) $\ge 32\text{ GB}$ $38\text{--}46\text{ tok/s}$ 🟢 Optimal
M1 / M2 / M3 / M4 Ultra (64GB - 192GB) $\ge 64\text{ GB}$ $62\text{--}78\text{ tok/s}$ 🟢 Maximum Throughput
M3 / M4 Pro (24GB - 36GB) $\ge 24\text{ GB}$ $26\text{--}32\text{ tok/s}$ 🟡 Supported

📜 Attribution & Lineage

  • Base Model Architecture: Qwen/Qwen3.8-27B
  • Fine-Tuning & Multi-Stage GAIN: DavidAU & Nightmedia
  • MLX Quantization & Optimization: Solstice-AI
  • License: Apache 2.0
@misc{solstice2026qwen38turbo,
  title={Qwen3.8-27B-TURBO-Fable-Cold-Fusion: Multi-Stage Distilled Uncensored Reasoning at 6-Bit MLX},
  author={Solstice-AI Research and DavidAU and Nightmedia},
  year={2026},
  publisher={Hugging Face},
  howpublished={\url{https://huggingface.co/Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-6Bit}}
}

README history 7 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-09-07docs: explicitly specify Mac mini M5 Pro (64GB) in performance table6f0019214.1 KB
    Loading...
  2. 2026-09-07docs: add restored MTP module, MLX speculative decoding, and DSpark serving r...461b3b314.1 KB
    Loading...
  3. 2026-09-07docs: correct empirical decode vs prefill throughput and clean MLX-LM serving...60aaebe10.5 KB
    Loading...
  4. 2026-09-03docs: update chat template with <think> reasoning tokens55270b210.6 KB
    Loading...
  5. 2026-09-03docs: 3x expanded model card with Apple MLX 6-bit affine specs, Anvil Metal 2...a927aab8.8 KB
    Loading...
  6. 2026-09-02docs: add institutional benchmark-verified model card with benchmarks and MLX...f6434905.9 KB
    Loading...
  7. 2026-09-02Upload folder using huggingface_hub332f4711.4 KB
    Loading...

Discussions 1 thread

  1. 2026-09-07Questions about the reported throughput (48–74 tok/s @ 256K context) — can't re…open3 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration