license: other
license_name: polyform-small-business-1.0.0
license_link: LICENSE
base_model: IstroSec/ThinkingCap-Qwen3.8-27B-abliterated
base_model_relation: quantized
library_name: mlx
pipeline_tag: text-generation
language:
- en
- multilingual
tags: - mlx
- qwen3_5
- qwen3_8
- thinkingcap
- abliterated
- uncensored
ThinkingCap-Qwen3.8-27B-abliterated, MLX 4-bit
An MLX 4-bit build (4.5 bits per weight, about 14 GB) of
IstroSec/ThinkingCap-Qwen3.8-27B-abliterated,
the uncensored variant of bottlecapai/ThinkingCap-Qwen3.8-27B
(a Qwen3.8-27B fine-tune that spends fewer thinking tokens).
Converted with mlx-lm 0.32.2, standard uniform 4-bit quantization, no changes to the weights
or the chat template:
mlx_lm.convert --hf-path IstroSec/ThinkingCap-Qwen3.8-27B-abliterated --mlx-path out-4bit -q --q-bits 4
Text generation through mlx-lm only; the vision input and the MTP draft head of the source
checkpoint were not tested in this build.
Use
pip install "mlx-lm>=0.32.2"
mlx_lm.generate --model tmthang86/ThinkingCap-Qwen3.8-27B-abliterated-mlx-4bit --max-tokens 3000 --prompt "..."
It is a thinking model: leave room for the reasoning before the answer.
Checked
Loaded on an Apple Silicon Mac with 48 GB: about 33 tokens per second, peak memory 15.8 GB,
valid JSON on a short Vietnamese contradiction-finding prompt. No benchmark was run on this build.
Licence
PolyForm Small Business License 1.0.0, with BottleCap AI's additional personal-use permission,
as in the source repository. LICENSE and NOTICE are copied unchanged. Check them before any
commercial use. The Qwen base model is by Alibaba Cloud / Qwen Team (Apache 2.0).