← back to catalog · registered 2026-09-24 08:57

OS-Software/ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-GGUF

OS-Software Qwen 27B GGUF
curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/OS-Software%2FThinkingCap-Qwen3.8-27B-Uncensored-Heretic-GGUF"
Response includes
  • classification m3
  • files 8
  • author_summary 25 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-09-24

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 0 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Quantizations
Q4_K Q5_K Q6_K Q8_0
Tags
transformers gguf qwen3_8 token-efficient efficient-thinking heretic uncensored decensored abliterated base_model:Qwen/Qwen3.8-27B base_model:finetune:Qwen/Qwen3.8-27B license:other

Related

Total size
80.5 GB
Files
8
Quantizations
6
Registered
2026-09-24 08:57
Last updated on HF
2026-09-24 08:17

Files by quantization

Q8_0 2 files 27.2 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-Q8_0.gguf 26.6 GB ab049af6 download
mmproj-Q8_0.gguf 600 MB 2da8816b download
Q6_K 1 file 20.6 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-Q6_K.gguf 20.6 GB 538f4270 download
Q5_K 1 file 17.9 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-Q5_K_M.gguf 17.9 GB fca2ffa2 download
Q4_K 1 file 15.4 GB
ThinkingCap-Qwen3.8-27B-Uncensored-Heretic-Q4_K_M.gguf 15.4 GB 933ae1eb download
BF16 1 file 888 MB
mmproj-BF16.gguf 888 MB 6e001a62 download
Auxiliary files 2 files 36.9 KB
README.md 35.0 KB bcdb6e32 download
.gitattributes 1.94 KB 5f72f22d download

README current version from Hugging Face


base_model: Qwen/Qwen3.8-27B
base_model_relation: finetune
library_name: transformers
tags:

  • qwen3_8

  • token-efficient

  • efficient-thinking

  • heretic

  • uncensored

  • decensored

  • abliterated
    license: other
    license_name: polyform-small-business-1.0.0
    license_link: LICENSE
    extra_gated_heading: Request access to the BottleCap AI model
    extra_gated_prompt: 'Request access below. Add your company if you''re evaluating
    this for work — we have enterprise versions that go further, and we''ll make sure
    you hear about them first. We''ll also send you new ThinkingCap releases and early
    access before they''re public.

    Tell us how you plan to use the model and we can help you get the most out of it
    — there''s a short form
    for that too.

    '
    extra_gated_fields:
    Name: text
    Company name (enter “N/A” if none): text
    Work email (enter your personal email if none): text
    extra_gated_button_content: Agree and request access


This is a decensored version of bottlecapai/ThinkingCap-Qwen3.8-27B, made using Heretic v2.0.0.dev0+custom

Abliteration parameters

Parameter Value
start_layer_index 27
end_layer_index 44
preserve_good_behavior_weight 1.0
steer_bad_behavior_weight 0.03
overcorrect_relative_weight 4.0
neighbor_count 1
ridge_regularization 0.00015
transport_rank 4
entropy_regularization 0.1
transport gaussian
lora_rank 128
row_normalization none
target_components attn.o_proj, mlp.down_proj
covariance_regularization 0.01
max_weight_change 1.0

Performance

Metric This model Original model (bottlecapai/ThinkingCap-Qwen3.8-27B)
Refusals 0/100 98/100
KL divergence 0.0173 0 (by definition)

⚠️ Important Notice

This model has undergone substantial reduction of its safety alignment. As a result, it is more likely than standard models to generate harmful, inaccurate, biased, offensive, or otherwise inappropriate content.

Intended Use

For research and experimentation only, including safety research, alignment studies, and red-teaming. Please avoid deploying it in public or end-user-facing services.

User Responsibility

All outputs should be treated as untrusted and independently verified before use. Users are solely responsible for:

  • Evaluating the accuracy and suitability of generated content
  • Implementing appropriate safeguards and human oversight
  • Complying with applicable laws, regulations, licenses, and ethical standards

Use of this model is entirely at your own risk.

Disclaimer

OS-Software provides this model without warranties of any kind and assumes no liability for any direct or indirect damages, losses, misuse, or legal consequences arising from its use.

Acknowledgements

Thanks to the base model developers, p-e-w for Heretic, and the wider open-source community.

This is a derivative work released under the base model’s applicable license. All rights to the base model remain with their respective owners.


ThinkingCap — BottleCap AI

ThinkingCap: Qwen 3.8 27B

In the second installment of our ThinkingCap series, we focus on maintaining the performance of
Qwen3.8-27B (Qwen Team, 2026) on challenging and agentic
tasks while delivering a substantial reduction in thinking verbosity. ThinkingCap Qwen3.8-27B cuts
reasoning tokens by 37% on average (11% to 66% depending on the benchmark)
and holds an average accuracy of 85.8% against the base model's 86.6%.
It shines in long-context retrieval, where it cuts reasoning by 39% with accuracy
intact (+2.3pp). Check our blogpost for more details.

Token efficiency and benchmark performance

BenchmarkAccuracyThinking tokens
BaseOursBase
mean
Ours
mean
Reduction
Knowledge & reasoning
GPQA-Diamond89.93 ±0.7088.04 ±1.0912,7727,267↓ 43.1%
MMLU-Pro85.54 ±0.6384.67 ±0.643,7251,591↓ 57.3%
MMMLU85.38 ±0.6984.09 ±0.721,656571↓ 65.5%
Math & code
AIME 202698.13 ±0.7494.27 ±1.4715,66310,934↓ 30.2%
HMMT (Feb 2026)95.83 ±1.1694.70 ±1.5023,21118,099↓ 22.0%
HMMT (Nov 2025)97.08 ±1.4396.04 ±2.1714,44310,037↓ 30.5%
LiveCodeBench v691.14 ±1.1191.21 ±1.2828,39522,645↓ 20.3%
Long-context & multimodal
AA-LCR81.75 ±1.0784.00 ±0.772,5501,565↓ 38.6%
RealWorldQA83.25 ±0.7382.34 ±0.71992492↓ 50.4%
Instruction following & agentic
IFBench79.75 ±0.6379.71 ±0.607,9614,266↓ 46.4%
τ²-bench76.16 ±1.5275.15 ±1.674,5843,168↓ 30.9%
Terminal-Bench 2.175.84 ±4.2675.28 ±4.3872,87165,092↓ 10.7%
Macro average86.685.815,73512,144↓ 37.2%
Evaluation details

Models

Base Qwen/Qwen3.8-27B against bottlecapai/ThinkingCap-Qwen3.8-27B, shown as Ours.

Metrics

  • Accuracy (Base / Ours) — fraction of correct answers. The τ²-bench score is an unweighted mean over its three domains (airline, retail, telecom), not pooled over tasks.

  • Thinking tokens (Base / Ours) — mean length of the <think> trace, answer excluded. τ²-bench and Terminal-Bench are multi-turn agentic episodes, so for those two rows the count is the reasoning summed over every turn of the episode (about 15 and 40 turns on average), not a single trace.

  • (Thinking token) Reduction — the relative change between the two mean columns beside it, (Ours − Base) / Base, where each mean is taken over every question and seed of the benchmark. A saving is shown as a green ↓ percentage.

  • Macro average (bottom row) — equal-weight mean across benchmarks of each column, including the reduction: it is the mean of the per-benchmark reductions, not the ratio of the two token figures beside it.

We separately track two trace-quality failure modes. Truncation: on the single-turn benchmarks, the <think> trace never closes because the model hits the generation cap while still reasoning, so no answer is produced. On the multi-turn benchmarks it is an episode-level flag, so it compounds over turns — τ²-bench marks an episode if any of its turns hits the per-turn cap, and Terminal-Bench marks a trial that exhausted its three-hour agent budget, which scores 0. Looping: the model repeating the same reasoning until it never finishes, detected with a compression-ratio test on the single-turn benchmarks and by the agent harness's own stalled-turn rule on Terminal-Bench. Both stay below 1% overall and both improve: truncation 0.51% → 0.34% and looping 0.06% → 0.05%, equal-weight across benchmarks.

Serving

Hardware: NVIDIA H200. vLLM 0.29.0, with MTP speculative decoding (num_speculative_tokens=3).

Thinking is on at reasoning_effort=xhigh, the chat template's own default, with the base model's
recommended sampling — temperature=1.0, top_p=0.95, top_k=20, min_p=0.0 — used
unchanged for Ours.

The generation cap is 253,952 tokens for most benchmarks. AA-LCR uses 131,072 and
τ²-bench 65,536, because their documents and multi-turn transcripts occupy the rest of
the window.

Benchmarks

Eleven run the complete set: AIME 2026 (30 problems), HMMT Feb 2026 (33), HMMT Nov 2025 (30),
GPQA-Diamond (198), IFBench (300), RealWorldQA (765), AA-LCR (100), τ²-bench (278 tasks
across airline, retail and telecom), Terminal-Bench 2.1 (89 tasks, Terminus-2 agent under Harbor),
LiveCodeBench v6 (175) and MMLU-Pro (12,032 — the whole test split).

MMMLU is the one subset: a 10,000-question random sample of the multilingual set, drawn
with a fixed seed so every condition sees the same questions.

Seeds and intervals

Independent runs per benchmark: 32 seeds on AIME 2026; 16 seeds on GPQA-Diamond, HMMT (Feb 2026), HMMT (Nov 2025) and IFBench; 8 seeds on LiveCodeBench v6, AA-LCR, RealWorldQA and τ²-bench; 4 seeds on Terminal-Bench 2.1; a single seed on MMLU-Pro and MMMLU. The seed count decides what the accuracy interval means. Multi-seed rows show the 95% t-interval across seeds — how much the answer moves when only the sampling seed changes, at Qwen's recommended temperature of 1.0. MMLU-Pro and MMMLU run a single seed over 12,032 and 9,996 questions, so they instead show a 95% Wilson interval over the question outcomes — how much the answer would move on a different draw of questions. The two measure different sources of variance and should not be read against each other.

Thinking mode comparison

We recommend using this model at the xhigh thinking effort for the best balance between accuracy and reasoning token usage. At lower efforts, the ThinkingCap treatment amplifies the effect of the effort setting while keeping its original trade-off. We plan to focus on improving the individual thinking modes in a future release.

Reasoning efforts comparison

Usage

HuggingFace Transformers

from transformers import AutoModelForImageTextToText, AutoProcessor
model = AutoModelForImageTextToText.from_pretrained("bottlecapai/ThinkingCap-Qwen3.8-27B", dtype="bfloat16")
proc = AutoProcessor.from_pretrained("bottlecapai/ThinkingCap-Qwen3.8-27B")

Check https://huggingface.co/Qwen/Qwen3.8-27B for recommended usage, sampling params etc.

vLLM / SGLang

Serve the bf16 model with either engine. The reasoning parser returns the thinking in a separate reasoning / reasoning_content field instead of inline in content before </think>, and the tool-call parser turns the model's XML tool calls into structured tool_calls — the same flags the base model's serving recipes use. The model's own MTP (multi-token-prediction / NextN) head gives self-speculative decoding with no separate draft model:

# vLLM — standard
vllm serve bottlecapai/ThinkingCap-Qwen3.8-27B \
  --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_xml
# vLLM — with MTP self-speculative decoding
vllm serve bottlecapai/ThinkingCap-Qwen3.8-27B \
  --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_xml \
  --speculative-config '{"method":"mtp","num_speculative_tokens":3}'

# SGLang — standard
python -m sglang.launch_server --model-path bottlecapai/ThinkingCap-Qwen3.8-27B --trust-remote-code \
  --reasoning-parser qwen3 --tool-call-parser qwen3_coder
# SGLang — with MTP self-speculative decoding
python -m sglang.launch_server --model-path bottlecapai/ThinkingCap-Qwen3.8-27B --trust-remote-code \
  --reasoning-parser qwen3 --tool-call-parser qwen3_coder \
  --speculative-algorithm EAGLE --speculative-num-steps 3 \
  --speculative-eagle-topk 1 --speculative-num-draft-tokens 4

MTP speculative decoding is lossless — the output is identical to standard decoding. On these bf16 weights, vLLM 0.29.0 with num_speculative_tokens=3 accepted 53% of drafted tokens across our xhigh evaluation runs — about 2.6 tokens per decoding step, identical to the base model's 54% and 2.6 — ranging from 2.5 on LiveCodeBench to 2.9 on τ²-bench and AA-LCR; the shorter traces at medium/low lift this to 3.2–3.3.

Either server speaks the OpenAI Chat Completions API. One request covers text, images and the thinking-effort knob:

from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="-")   # SGLang: port 30000
r = client.chat.completions.create(
    model="bottlecapai/ThinkingCap-Qwen3.8-27B",
    messages=[{"role": "user", "content": [
        {"type": "image_url", "image_url": {"url": "https://example.com/photo.jpg"}},
        {"type": "text", "text": "What is happening in this picture?"},
    ]}],
    temperature=1.0, top_p=0.95,
    extra_body={"top_k": 20,
                "chat_template_kwargs": {"reasoning_effort": "xhigh"}},   # xhigh (default) | medium | low
)
print(r.choices[0].message.reasoning)               # the thinking (`reasoning_content` on SGLang)
print(r.choices[0].message.content)                 # the answer

A text-only request is the same call with a plain string as content.

Quantized versions

Same checkpoint, chat template and license, quantized for smaller footprints and faster serving:

All builds are gathered in this collection.

Where to find us

Website LinkedIn Instagram X

Need even more efficiency? The open release is production-ready. Our enterprise versions go further — fewer thinking tokens still, tuned to your workload, at matched accuracy on your own tasks. Built for AI labs, inference providers and enterprises running models at scale. Deployed on your infrastructure, or in the cloud and region you choose.
Talk to our team

License

ThinkingCap: PolyForm Small Business 1.0.0 + BottleCap personal-use grant (see LICENSE).

Upstream Qwen materials: Apache-2.0 (see NOTICE).

Commercial license: contact BottleCap AI.

Citation

If you use this model, please cite:

@misc{ThinkingCap-Qwen3.8-27B,
  title     = {bottlecapai/ThinkingCap-Qwen3.8-27B},
  author    = {Osusky, Adam and Lindauer, Jan and Jirkovsky, Adam and Mihal, Filip and Platek, Ondrej and Herel, David and Ihnatchenko, Luka and Bartek, Vojtech and Jirak, Jiri and Kubista, Daniel and Krus, Frantisek and Mikolov, Tomas},
  year      = {2026},
}
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in app" button that hands off directly to a local runtime of your choice - Abliteration, LM Studio, or Ollama. No API keys, no subscription, no prompt leakage.