← back to catalog · registered 2026-08-22 13:56

ggolani/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-mlx-4Bit

ggolani Qwen 39B multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/ggolani%2FQwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-mlx-4Bit"
Response includes
  • classification m3
  • files 13
  • hub_downloads_all_time 3,746
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · lifetime
4K
159 last 30d - cooling
Likes
2
Model age
4mo ago
created 2026-05-27

Training datasets

Corpora the author lists in the model card. Datasets tracked in our /datasets catalog carry a category badge linking to the workflow stage. Others open on Hugging Face.

Downloads over time
Now3.8K→from1.7K↑128%
1.6K2.4K3.2K4K1.7K on Jun 103.8K on Oct 11JunJulAugSepOct
Jun 10 → Oct 11 · 57 snapshots · spans 123 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en zh
Tags
transformers safetensors qwen3_5 image-text-to-text unsloth fine tune heretic uncensored abliterated multi-stage tuned. all use cases coder

Related

Total size
20.5 GB
Files
13
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-05-27 02:14

Files by quantization

Auxiliary files 13 files 20.5 GB
model-00002-of-00005.safetensors 4.99 GB a34a9da7 download
model-00003-of-00005.safetensors 4.98 GB d96b9932 download
model-00001-of-00005.safetensors 4.96 GB c78bfc32 download
model-00004-of-00005.safetensors 4.88 GB 698bad21 download
model-00005-of-00005.safetensors 682 MB aa3093b5 download
tokenizer.json 19.1 MB 87a7830d download
model.safetensors.index.json 278 KB edc9c0d5 download
chat_template.jinja 7.58 KB a8755d82 download
config.json 5.08 KB d46948ea download
README.md 1.71 KB d06573f1 download
.gitattributes 1.53 KB 52373fe2 download
tokenizer_config.json 1.11 KB f57cfc38 download
generation_config.json 202 B 023756cf download

README current version from Hugging Face


language:

  • en
  • zh
    license: apache-2.0
    tags:
  • unsloth
  • fine tune
  • heretic
  • uncensored
  • abliterated
  • multi-stage tuned.
  • all use cases
  • coder
  • creative
  • creative writing
  • fiction writing
  • plot generation
  • sub-plot generation
  • story generation
  • scene continue
  • storytelling
  • fiction story
  • science fiction
  • romance
  • all genres
  • story
  • writing
  • vivid prosing
  • vivid writing
  • fiction
  • roleplaying
  • bfloat16
  • mlx
  • mlx-my-repo
    datasets:
  • TeichAI/claude-4.5-opus-high-reasoning-250x
  • DavidAU/PkDick-Deckard-5-Datasets
    pipeline_tag: image-text-to-text
    library_name: transformers
    base_model: DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking

ggolani/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-mlx-4Bit

The Model ggolani/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-mlx-4Bit was converted to MLX format from DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking using mlx-lm version 0.31.2.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("ggolani/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-mlx-4Bit")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-05-27Upload folder using huggingface_hub1d3d8e51.7 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration