← back to catalog · registered 2026-11-12 07:03

kabcnd/Kenzan-Qwen3.8-27B-Abliterated-GGUF

kabcnd 27B GGUF second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/kabcnd%2FKenzan-Qwen3.8-27B-Abliterated-GGUF"
Response includes
  • classification m8
  • files 3
  • author_summary 3 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
153
Likes
2
Model age
1w ago
created 2026-11-12
Downloads over time
Now 153 → from 0 ↑ 0%
056112168 0 on Nov 12 153 on Nov 22 Nov
Nov 12 → Nov 22 · 11 snapshots · spans 10 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en zh ru
Tags
gguf kenzan ternary ptq1_0 q4_1 1.75-bit hybrid abliterated uncensored qwen apple-silicon metal

Related

Total size
6.43 GB
Files
3
Quantizations
1
Registered
2026-11-12 07:03
Last updated on HF
2026-11-18 06:19

Files by quantization

Auxiliary files 3 files 6.43 GB
Kenzan-Qwen3.8-27B-Abliterated-Core16-Q4_1-M6-16G.gguf 6.43 GB ******** download
README.md 10.1 KB 5bbde961 download
.gitattributes 1.57 KB 079c2e28 download

README current version from Hugging Face


license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.8-27B-abliterated
tags:

  • kenzan
  • gguf
  • ternary
  • ptq1_0
  • q4_1
  • 1.75-bit
  • hybrid
  • abliterated
  • uncensored
  • qwen
  • apple-silicon
  • metal
  • codebook
  • speculative-decoding
  • dflash2
  • kenzan-router
  • llama.cpp
    pipeline_tag: text-generation
    language:
  • en
  • zh
  • ru
    inference: false
    extra_gated_heading: "Mandatory Liability Waiver & Uncensored Model Agreement"
    extra_gated_prompt: >
    WARNING: This repository hosts an ABLITERATED (uncensored) 27B language model with safety refusals removed.
    By requesting access to, downloading, or using this model (or any other models published by kabcnd / the Kenzan Project),
    you explicitly acknowledge, sign, and agree to the following legally binding terms:
    (1) SOLE RESPONSIBILITY: You assume 100% personal and legal responsibility for all prompts, outputs, deployments, and consequences arising from the use of this model or any other models provided by kabcnd / the Kenzan Project.
    (2) FULL RELEASE OF LIABILITY: The author(s), maintainer(s), and contributors (kabcnd / Kenzan Project) bear ZERO liability and are hereby completely released and held harmless from any claims, damages, misuse, illegal acts, or direct/indirect harm caused by this model or any other Kenzan / Huihui / Flint models.
    (3) LAWFUL USE ONLY: You will use this model strictly for lawful research, red-teaming, security evaluation, or authorized local testing in compliance with all applicable laws in your jurisdiction.
    extra_gated_fields:
    Full Name or Signature (required to sign waiver): text
    Organization / Affiliation (or Independent Researcher): text
    I confirm that I am at least 18 years old: checkbox
    I accept 100% personal responsibility and release kabcnd / Kenzan Project from all liability for any harm caused by this or other models: checkbox
    extra_gated_button_content: "Sign Liability Waiver & Unlock Download"

☕ Support Local AI Development: Help me acquire a Mac mini 24GB/32GB to optimize and test local MoE models up to 80B parameters. Donate via Ko-fi →

[!CAUTION]
Kenzan-Qwen3.8-27B-Abliterated-Core16 — "27B Uncensored, 16 Surgical Layers, 93.75% Speculative DAR, 6.43 GiB."
Abliterated models normally shatter speculative drafting at 35% acceptance — so we reverse-engineered Apple Metal's mc_c2/mc_c3 GEMV kernels, restored layers 22–29 back to PTQ1_0, and pinned only the 16 true refusal-core layers (30..45) in Q4_1 to hit 20.87 t/s at 128k context inside 16 GB RAM.


Kenzan-Qwen3.8-27B-Abliterated-Core16 (6.43 GiB GGUF)

Kenzan-Qwen3.8-27B-Abliterated-Core16 (Kenzan-Qwen3.8-27B-Abliterated-Core16-Q4_1-M6-16G.gguf) is a surgically repacked hybrid quantization of huihui-ai/Huihui-Qwen3.8-27B-abliterated (27B parameters, 64 layers, GQA 32/16, 128k native context) engineered for Apple Silicon 16 GB Unified Memory (Mac mini M6).

Short Summary: Kenzan-Qwen3.8-27B-Abliterated-Core16 (6.43 GiB GGUF) — Surgical Hybrid PTQ1_0 (1.75 bpw) + Core16 Q4_1 (layers 30–45) 27B uncensored model tuned for Apple Silicon 16 GB Unified Memory, achieving FP16 PPL parity (3.6742), 93.75% DFlash2 DAR, and 20.87 t/s at 128k context.


Architecture & Surgical Core16 Pinning

When abliteration removes the rank-1 refusal direction from PTQ1_0 (1.75 bpw Codebook-LUT) weights, naive builds promote all 54 layers (22..52) to Q4_1. This inflates the model to 6.86 GiB and introduces phase drift across layers 24..30 where the DFlash2 speculative draft head taps hidden states — crashing draft acceptance rate (DAR) to 35.0% (6.9–8.05 t/s).

By measuring layer-wise Frobenius norm delta ||W_new - W_old||_F:

  • Layers 0..21 & 46..63: 0.0% refusal energy → kept in native PTQ1_0.
  • Layers 22..29: Only 14.8% refusal energy, but directly in the DFlash2 tap zone → restored to native PTQ1_0.
  • Layers 30..45 (Core16): 85.2% of total refusal energy → pinned in Q4_1.
  • Release Metadata ID: Kenzan-Qwen3.8-27B-Abliterated [Core16: L30-45 Q4_1 + PTQ1_0 | DFlash2 | Apple M6 16GB]

Verified Benchmarks (Mac mini M6, 16 GB Unified Memory)

Measured directly on Apple Silicon Metal GPU (-ngl 99 --no-host -fa on --cache-type-k q4_0 --cache-type-v q4_0) with DFlash2 speculative decoding and GGML_METAL_PTQ1_MULTICOL=1:

Configuration Mode DFlash2 DAR Token Latency Speed Process RSS Context
Naive Hybrid v1 (54 layers Q4_1) Slow 35.0% 124.22 ms 8.05 t/s 10.85 GiB 32k
Pure Metal LUT (No Speculation) Baseline — 60.56 ms 16.51 t/s 7.65 GiB 32k
Core16 (n-max 1, p-min 0.58) mc_c2 87.45% 52.14 ms 19.18 t/s 8.18 GiB 32k
Core16 (n-max 2, p-min 0.65) mc_c3 88.45% 52.32 ms 19.11 t/s 8.18 GiB 32k
Core16 + Full 128k Context mc_c2 93.75% 47.91 ms 20.87 t/s 9.97 GiB 131,072
  • Perplexity (PPL): 3.6742 ± 0.3901 (vs 3.65 original FP16 baseline; 3.9214 on Hybrid v1).
  • Prompt Prefix Cache (--cache-ram 1024): Reduces repeated 1k-token prompt eval latency from 1005 ms to 140 ms (-86.1%).
  • Dynamic Vision Support (kenzan_router.py): Routes text-only traffic to the lean kenzan-qwen3.8:27b backend and seamlessly switches to kenzan-qwen3.8:27b-vision (--mmproj Q8_0) when images are present in the payload.

Quick Start & Recommended Deployment (Apple Silicon 16 GB)

Important Runtime Requirement: Stock upstream llama.cpp cannot load PTQ1_0 Codebook-LUT weights or DFlash2 speculative draft heads. You must use the patched PrismML-Eng/llama.cpp Metal runtime (mac-flint v0.7.0-dev build 12128 or newer).

1. Required Binaries & Patched Metal Libraries

Download the model (after signing the gated waiver above), the precompiled macOS ARM64 runtime bundle, and tools/kenzan_router.py:

# After signing the waiver, download with your HF token:
hf download kabcnd/Kenzan-Qwen3.8-27B-Abliterated-GGUF \
  Kenzan-Qwen3.8-27B-Abliterated-Core16-Q4_1-M6-16G.gguf \
  bin/llama-flint-metal-macos-arm64.tar.gz \
  tools/kenzan_router.py --local-dir .

tar -zxvf bin/llama-flint-metal-macos-arm64.tar.gz
export DYLD_LIBRARY_PATH="$(pwd)/llama-flint:$DYLD_LIBRARY_PATH"

2. Mandatory Metal & DFlash2 Environment Variables

Enable mc_c2/mc_c3 multi-column Metal register tiling and fused DFlash2 FFN execution, and clear conflicting pipeline flags:

export GGML_METAL_PTQ1_MULTICOL=1
export LLAMA_DFLASH_FUSED_FFN=1
export LLAMA_SPEC_ARBITER_MODE=active
unset LLAMA_SPEC_PIPELINE LLAMA_SPEC_PIPE_MODE GGML_OP_OFFLOAD_MIN_BATCH

3. Production llama-server Launch Command (128k Context, ~10 GiB RSS)

./llama-flint/llama-server \
  -m Kenzan-Qwen3.8-27B-Abliterated-Core16-Q4_1-M6-16G.gguf \
  -md Ternary-Bonsai-2-27B-DFlash2-ft5-asym-Q2_K-FC-FullRank.gguf \
  --spec-type draft-dflash \
  --spec-draft-n-max 1 --spec-draft-n-min 1 --spec-draft-p-min 0.58 --spec-draft-ngl 99 \
  --host 127.0.0.1 --port 11435 \
  -ngl 99 --no-host -fa on \
  -c 131072 --cache-type-k q4_0 --cache-type-v q4_0 -kvu -np 1 \
  -t 4 -b 512 -ub 512 --cache-ram 1024 --fit off \
  --jinja --reasoning-preserve --metrics \
  --temp 0.7 --top-p 0.9 --top-k 40 --min-p 0.05 \
  --repeat-penalty 1.02 --presence-penalty 0.15 --frequency-penalty 0.15 \
  --alias "kenzan-qwen3.8:27b"

You can also run the unified multi-model proxy tools/kenzan_router.py on port 11434 (kenzan-qwen3.8:27b / kenzan-qwen3.8:27b-vision / kenzan-flint:40b / bonsai-2:latest).


Liability Waiver & Responsible Use Disclaimer

This model is an abliterated (uncensored) research artifact with safety refusal directions removed. By downloading, loading, or executing this model or any other model published by kabcnd / Kenzan Project, you agree that:

  1. You assume full and exclusive responsibility for all outputs, deployments, and consequences.
  2. The authors and maintainers (kabcnd / Kenzan Project) are completely released from any and all liability for misuse, damages, or harm arising from this or any other model in the Kenzan / Huihui / Flint series.
  3. You will use this model solely for lawful, ethical, and authorized research purposes.

Acknowledgements & Inspiration

  • Prism ML (https://huggingface.co/prism-ml) — Inspired by and built upon the Bonsai-2 architecture, PTQ1_0 ternary quantization, DFlash2 speculative drafting, and the Metal kernel foundations that made 27B/40B inference on 16 GB consumer hardware possible.
  • Huihui-AI (https://huggingface.co/huihui-ai) — For the upstream Huihui-Qwen3.8-27B-abliterated base model.
  • Misha — Special thanks to Misha for ongoing support, encouragement, and financial assistance that helped keep this local AI hardware research moving forward.

Support the Project & Funding Goals

I am an independent researcher optimizing frontier 27B–80B models to run locally on affordable consumer hardware without expensive NVIDIA server clusters.

Current Hardware Fundraising Goal: Mac mini 24 GB / 32 GB Unified Memory

  • Why it matters: Testing and calibrating 40B–80B MoE models on a base 16 GB Mac mini hits a hard physical ceiling (~12.5 GB wired Metal limit). A Mac mini 24 GB / 32 GB will unlock higher-precision anchor grids, larger KV caches, and full 70B–80B ternary/4-bit hybrid models for the open-source community.
  • What your support funds: Direct hardware upgrades, open-source GGUF releases, Metal kernel benchmarks, and reproducible quantization tooling.

☕ Support Local AI Research on Ko-fi →

Even a small contribution or sharing this repository helps enormously. Thank you! ❤️

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration