← back to catalog · registered 2026-09-25 05:57

mradermacher/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-i1-GGUF

mradermacher 27B GGUF second-order
curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/mradermacher%2FThinkingCap-Qwen3.8-27B-Uncensored-Heretic-i1-GGUF"
Response includes
  • classification m3
  • files 9
  • author_summary 3261 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-09-25

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 0 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Languages
en
Quantizations
IQ3 Q2_K Q3_K Q4_K
Tags
transformers gguf qwen3_8 token-efficient efficient-thinking heretic uncensored decensored abliterated en base_model:OS-Software/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic base_model:quantized:OS-Software/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic

Related

Total size
74.4 GB
Files
9
Quantizations
5
Registered
2026-09-25 05:57
Last updated on HF
2026-09-25 06:48

Files by quantization

Q4_K 2 files 29.9 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-Q4_K_M.gguf 15.4 GB a79635ef download
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-Q4_K_S.gguf 14.5 GB d135ff07 download
Q3_K 1 file 12.4 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-Q3_K_M.gguf 12.4 GB d8a6bf18 download
IQ3 2 files 22.1 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-IQ3_M.gguf 11.7 GB c6553d2e download
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-IQ3_XXS.gguf 10.4 GB 81e784ba download
Q2_K 1 file 9.98 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.i1-Q2_K.gguf 9.98 GB bc2f9927 download
Auxiliary files 3 files 13.0 MB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic.imatrix.gguf 13.0 MB 2f3673df download
README.md 3.55 KB 8b29f1f7 download
.gitattributes 2.12 KB 19c9a130 download

README current version from Hugging Face


base_model: OS-Software/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic
extra_gated_button_content: Agree and request access
extra_gated_fields:
Company name (enter “N/A” if none): text
Name: text
Work email (enter your personal email if none): text
extra_gated_heading: Request access to the BottleCap AI model
extra_gated_prompt: |
Request access below. Add your company if you're evaluating this for work — we have enterprise versions that go further, and we'll make sure you hear about them first. We'll also send you new ThinkingCap releases and early access before they're public.

Tell us how you plan to use the model and we can help you get the most out of it — there's a short form for that too.
language:

  • en
    library_name: transformers
    license: other
    license_link: LICENSE
    license_name: polyform-small-business-1.0.0
    mradermacher:
    readme_rev: 1
    quantized_by: mradermacher
    tags:
  • qwen3_8
  • token-efficient
  • efficient-thinking
  • heretic
  • uncensored
  • decensored
  • abliterated

About

weighted/imatrix quants of https://huggingface.co/OS-Software/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's
READMEs
for
more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
GGUF imatrix 0.1 imatrix file (for creating your own quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

image.png

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-09-25auto-patch README.md7fc57213.5 KB
    Loading...
  2. 2026-09-25uploaded from marco11218ff500 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in app" button that hands off directly to a local runtime of your choice - Abliteration, LM Studio, or Ollama. No API keys, no subscription, no prompt leakage.