← back to catalog · registered 2026-08-22 13:56

protoLabsAI/ThinkingCap-Qwen3.6-27B-abliterated-MTP-GGUF

protoLabsAI Qwen 27B GGUF 262K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/protoLabsAI%2FThinkingCap-Qwen3.6-27B-abliterated-MTP-GGUF"
Response includes
  • classification m8
  • files 12
  • hub_downloads_all_time 6,817
  • author_summary 3 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
7K
Likes
8
Model age
2mo ago
created 2026-07-28
Downloads over time
Now6.8K→from6.8K↑0%
6.8K6.8K6.8K6.8K6.8K on Aug 56.8K on Oct 11AugSepOct
Aug 5 → Oct 11 · 50 snapshots · spans 67 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Quantizations
Q3_K Q4_K Q5_K
Tags
gguf nvfp4 mtp speculative-decoding blackwell abliterated uncensored security qwen3.6 text-generation base_model:bottlecapai/ThinkingCap-Qwen3.6-27B base_model:quantized:bottlecapai/ThinkingCap-Qwen3.6-27B

Related

Total size
198 GB
Files
12
Quantizations
4
Registered
2026-08-22 13:56
Last updated on HF
2026-08-07 00:13

Files by quantization

Q5_K 1 file 18.2 GB
ThinkingCap-Qwen3.6-27B-heretic-Q5_K_M-MTP.gguf 18.2 GB ******** download
Q4_K 1 file 15.7 GB
ThinkingCap-Qwen3.6-27B-heretic-Q4_K_M-MTP.gguf 15.7 GB ******** download
Q3_K 1 file 12.6 GB
ThinkingCap-Qwen3.6-27B-heretic-Q3_K_M-MTP.gguf 12.6 GB ******** download
Auxiliary files 9 files 152 GB
ThinkingCap-Qwen3.6-27B-heretic-bf16-MTP.gguf 50.9 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-Q8_0-MTP.gguf 27.1 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-Q6_K-MTP.gguf 20.9 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-NVFP4-MTP.gguf 17.0 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-IQ4_XS-MTP.gguf 14.3 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-IQ3_M-MTP.gguf 11.9 GB ******** download
ThinkingCap-Qwen3.6-27B-heretic-IQ2_M-MTP.gguf 9.64 GB ******** download
README.md 7.53 KB b8e48cc5 download
.gitattributes 2.38 KB b091dea4 download

README current version from Hugging Face


license: apache-2.0
base_model: bottlecapai/ThinkingCap-Qwen3.6-27B
base_model_relation: quantized
pipeline_tag: text-generation
tags:

  • gguf
  • nvfp4
  • mtp
  • speculative-decoding
  • blackwell
  • abliterated
  • uncensored
  • security
  • qwen3.6
    extra_gated_prompt: >-
    This model is DEPRECATED and no longer distributed. Access requests are not
    being reviewed or approved.

ThinkingCap-Qwen3.6-27B-abliterated GGUF (MTP baked in)

[!WARNING]
DEPRECATED — 2026-08-07. This release has been withdrawn and is no longer
distributed or maintained. Access is gated and requests will not be approved.
No successor is designated.

Refusal-free ThinkingCap for authorized malware and vulnerability analysis, pentesting, and
defensive security research.
Native FP4 for Blackwell, a Multi-Token-Prediction draft head
baked into every quant (+44% decode), and the full ladder from IQ2 to a lossless bf16 master,
with the base model's capability preserved.

protoLabsAI · Qwen3.6-27B lineage · GGUF for llama.cpp / Ollama · companion to the
base MTP-GGUF release
(same roster, so apples-to-apples).


⚠️ Dual-use, read first

This is an abliterated (refusal-free) model. It produces working exploit PoCs, offensive
tooling, and attack reasoning without guardrails, by design, because built-in refusals
sabotage authorized security work (a model can't help prove a vulnerability it refuses to
discuss). The safety boundary lives with the operator, not the weights.

Intended strictly for: authorized pentest / red-team / blue-team, malware and vulnerability
analysis, CTF, and find→prove→fix research on systems you own or are permitted to test. Not
for unauthorized access, targeting third parties, or abuse. Same dual-use profile as Metasploit,
a fuzzer, or any abliterated base, shipped in that spirit, with honest numbers and explicit scope.


Why refusal-free

Digital attacks keep getting more sophisticated and more automated, and defenders, analysts, and
security researchers need tools that can keep pace. Built-in refusals handicap only the authorized
side: an attacker does not reach for a guarded model, while a defender trying to reverse a malware
sample or prove a vulnerability before it is exploited gets stopped cold by one. A refusal-free
model puts that capability, and the governance of how it is used, back in the operator's hands.

The tradeoff to watch with any abliteration is capability loss. We measured it:

axis result how measured
Refusal-free 0/4 refused on real malware/vuln/exploit/pentest tasks (thinking on); 3.6% on a 192-prompt offensive probe (no-think), and those few are vague "harm-framed" prompts answered with soft disclaimers authorized-pentest framing; phrase-match detector plus manual read
Coding preserved abliterated 7/15 = base 7/15 fully-solved (means 0.58 vs 0.66, within n=15 noise) LiveCodeBench, hard, post-2025 (contamination-resistant), exec-graded, no-think, abliterated vs the clean ThinkingCap base
MTP speedup +44%: 73.4 to 105.8 tok/s (Q4_K_M) llama.cpp --spec-type draft-mtp, RTX PRO 6000 Blackwell

Abliteration did not cost ThinkingCap its coding. (Note: an earlier internal "35% refusal /
abliteration-hurts-agentic" reading turned out to be a measurement artifact, unframed and
thinking-on; under real deployment framing the model is effectively decensored and
capability-neutral.)


Files

MTP is baked into every quant (blk.64.nextn.*), so no separate draft file is needed; activate
it with --spec-type draft-mtp. Sizes track the base roster.

quant size notes
NVFP4-MTP 17 GB Blackwell FP4 tensor cores plus MTP. The one to grab on RTX 50xx / PRO 6000.
bf16-MTP 51 GB lossless master (exact bf16) plus MTP
Q8_0-MTP 28 GB near-lossless reference plus MTP
Q6_K-MTP 21 GB plus MTP
Q5_K_M-MTP 19 GB plus MTP
Q4_K_M-MTP 16 GB plus MTP. Common daily-driver size, carries the draft head.
IQ4_XS-MTP 15 GB imatrix low-bit plus MTP
IQ3_M-MTP 12 GB imatrix low-bit plus MTP. Smallest full-quality rung, fits a 16 GB card.
IQ2_M-MTP ~10 GB imatrix low-bit plus MTP. Fits a 12 GB card.
mtp-…-head-Q8_0 ~2.4 GB standalone draft head, to pair with a base GGUF via --model-draft

Run it

# llama.cpp: MTP baked in; turn on speculative decode for the +44%
llama-cli -m ThinkingCap-Qwen3.6-27B-heretic-Q4_K_M-MTP.gguf -ngl 99 --spec-type draft-mtp \
  -p "..." --temp 0.6 --top-p 0.95 --top-k 20

Do not use greedy decoding (this is a thinking model, it degenerates). Recommended:
temp 0.6, top-p 0.95, top-k 20. NVFP4 delivers its speedup only on Blackwell (sm120); on
Ampere/Ada it runs but without the FP4 tensor-core path, so use a K-quant there.

Compatibility

MTP-baked GGUFs need a recent runtime that understands the blk.N.nextn.* block:

runtime status
llama.cpp tested ✅ (recent build; MTP via --spec-type draft-mtp)
Ollama needs a recent version for the baked MTP block; older versions may report "missing attn_qkv" (not tested on this file)

Benchmarks (measured)

Decode speed (single-stream local decode, the metric a one-card local user experiences):

quant MTP off MTP on (--spec-type draft-mtp) hardware
Q4_K_M 73.4 tok/s 105.8 tok/s (+44%) RTX PRO 6000 Blackwell (sm120)
NVFP4 n/a 146.7 tok/s RTX PRO 6000 Blackwell (sm120)

Ampere/Ada (A6000) and Apple Silicon (M1) points not yet measured. NVFP4's FP4 tensor-core
speedup is Blackwell-only; on other hardware use a K-quant.

Depth-coherence (real-text needle retrieval + degeneration detectors + adversarial judge, at
4K / 16K / 32K / 60K): PASS at every depth on Q4_K_M, NVFP4, and IQ2_M (the 2-bit rung).
No quant rot, coherent to full depth even at 2-bit.

LiveCodeBench (hard, post-2025, exec-graded, no-think): 7/15 fully-solved, matching the clean
ThinkingCap base.

Provenance and recipe

  • Base: bottlecapai/ThinkingCap-Qwen3.6-27B (Qwen3.6-27B reasoning finetune, native MTP).
  • Abliteration: Heretic (single-direction refusal ablation, bf16).
  • MTP graft: abliteration drops the MTP head, so we grafted the base's 15 mtp.* tensors back into a merged staging checkpoint before conversion, making the head native to every quant.
  • GGUF: convert_hf_to_gguf (maps mtp.* to blk.64.nextn.*); K-quants via llama-quantize;
    IQ rungs use an imatrix from a diverse general + agentic + security corpus; NVFP4 converted from
    the compressed-tensors vLLM artifact, then mixed (NVFP4 GEMMs, Q8_0 rest). The imatrix does not
    cover the MTP block (it only fires during speculative decoding, not the forward pass), so the
    2-bit IQ2_M keeps the small blk.64 MTP block at Q6_K.

Also available (vLLM): an NVFP4 compressed-tensors build for vLLM serving lives in the companion
repo protoLabsAI/ThinkingCap-Qwen3.6-27B-abliterated-NVFP4. MTP speculative decoding is carried by
these GGUFs (llama.cpp); the vLLM build serves NVFP4 without the draft head.

Need a different size or format?

Open a Community discussion and we usually ship requested quants within 48h.


Safety note (abliterated model): refusal rate is reported above, not gated. This is a security
tool; scope and authorization are the operator's responsibility.

Discussions 1 thread

  1. 2026-08-02Not abliterated :(closed4 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration