← back to catalog · registered 2026-11-17 18:04

Ibnfarik/Huihui-Qwen3.6-27B-abliterated-MNN

Ibnfarik 27B multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Ibnfarik%2FHuihui-Qwen3.6-27B-abliterated-MNN"
Response includes
  • classification m1
  • files 13
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
26
Likes
0
Model age
4d ago
created 2026-11-17
Downloads over time
Now 26 → from 0 ↑ 0%
0101929 0 on Nov 17 26 on Nov 22 26 on Nov 20 Nov
Nov 17 → Nov 22 · 6 snapshots · spans 5 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en zh
Quantizations
BF16
Tags
mnn tokforge on-device chat qwen qwen3.6 qwen3_5 image-text-to-text vlm multimodal abliterated en

Related

Total size
2.37 GB
Files
13
Quantizations
2
Registered
2026-11-17 18:04
Last updated on HF
2026-11-17 17:46

Files by quantization

BF16 1 file 2.37 GB
embeddings_bf16.bin 2.37 GB 8e363559 download
Auxiliary files 12 files 15.2 GB
llm.mnn.weight 14.9 GB c1c08714 download
visual.mnn.weight 249 MB 8f2a00ce download
llm.mnn.json 21.4 MB 732d7018 download
llm.mnn 8.46 MB c9457f0c download
tokenizer.txt 6.17 MB 30439bef download
visual.mnn 805 KB fce22af1 download
tokforge_benchmarks.json 19.6 KB 7184f90a download
llm_config.json 8.46 KB e48c551b download
README.md 6.08 KB 3fd152ad download
.gitattributes 1.72 KB e23c58dd download
export_args.json 1.09 KB 4a5c9bfe download
config.json 387 B 2d94fea9 download

README current version from Hugging Face


license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.6-27B-abliterated
base_model_relation: quantized
pipeline_tag: image-text-to-text
library_name: mnn
language:

  • en
  • zh
    tags:
  • tokforge
  • on-device
  • mnn
  • chat
  • qwen
  • qwen3.6
  • qwen3_5
  • image-text-to-text
  • vlm
  • multimodal
  • abliterated

Huihui Qwen3.6 27B abliterated (MNN)

huihui-ai's abliterated Qwen3.6 27B as a 4-bit MNN bundle, with its vision encoder, for 24 GB phones running TokForge.

Published by TokForge for on-device inference.

What it is Vision chat model (text + images; abliterated)
Format MNN bundle, HQQ 4-bit weights (block 64), with vision encoder
Runs on Android phones (CPU); also MNN's llm_demo on a computer
Phone class 24 GB RAM for practical use; 16 GB phones load it but time out on longer prompts
Download 18.9 GB (11 files)
Base model huihui-ai/Huihui-Qwen3.6-27B-abliterated
License Apache-2.0

TokForge

Runs on-device in the TokForge app.

Use it in TokForge

  1. Install TokForge from Google Play, or join the iOS TestFlight.
  2. On Android, open Models > Browse, search for Huihui-Qwen3.6-27B-abliterated-MNN and download it.
  3. Load it and start a chat. The model runs on the phone; once it is downloaded, chatting needs no connection.

Use it with upstream MNN llm_demo

pip install -U huggingface_hub
hf download darkmaniac7/Huihui-Qwen3.6-27B-abliterated-MNN --local-dir Huihui-Qwen3.6-27B-abliterated-MNN
git clone https://github.com/alibaba/MNN.git
cd MNN
mkdir build && cd build
cmake .. -DMNN_LOW_MEMORY=true -DMNN_CPU_WEIGHT_DEQUANT_GEMM=true \
         -DMNN_BUILD_LLM=true -DMNN_SUPPORT_TRANSFORMER_FUSE=true
make -j

./llm_demo /path/to/Huihui-Qwen3.6-27B-abliterated-MNN/config.json prompt.txt

Collections: TokForge Qwen Models (MNN), TokForge Vision Models.

Files

File Size What it is
config.json 387 B MNN runtime settings
embeddings_bf16.bin 2.54 GB Token embeddings (bf16)
export_args.json 1.12 KB Export settings used for the conversion
llm.mnn 8.87 MB Model graph
llm.mnn.json 22.4 MB Model graph as JSON (reference copy)
llm.mnn.weight 16.0 GB Model weights
llm_config.json 8.66 KB Model settings and chat template
tokenizer.txt 6.47 MB Tokenizer
tokforge_benchmarks.json 20.1 KB Raw summary of TokForge's device checks (April and May 2026)
visual.mnn 825 KB Vision encoder graph (Qwen3.6 vision sidecar)
visual.mnn.weight 261 MB Vision encoder weights

About the model

MNN-format 4-bit TokForge export of huihui-ai/Huihui-Qwen3.6-27B-abliterated, packaged for Android on-device inference with TokForge.

Source checkpoint huihui-ai/Huihui-Qwen3.6-27B-abliterated
Base model Qwen/Qwen3.6-27B
Source snapshot SHA 27502c8717fd5a2f8c0c77188c10c243fd4f672e
Architecture qwen3_5, 64 layers (48 of them linear attention), hidden size 5120, 24 attention heads, 4 KV heads, hybrid linear + full attention, MRoPE, DeepStack vision sidecar

Vision

The bundle includes the vision encoder (visual.mnn, visual.mnn.weight), and llm_config.json marks the model as
a vision model (is_visual). TokForge's device checks covered text generation only.

Device notes

In TokForge's device checks (April 30 and May 1, 2026), the 24 GB phones (RedMagic, Redmi) completed every prompt and
are practical for short local text generation with this export. The 16 GB phones can load the model, but longer
paragraph or code prompts are not practical in this CPU MNN configuration: OnePlus and Lenovo completed short and code
prompts but timed out on paragraph generation; S26 and Pixel completed only arithmetic and a short sentence before
timing out on longer prompts.

How it was made

Exported with MNN's llmexport (settings in export_args.json):

Flag Value
--quant_bit 4
--quant_block 64
--lm_quant_bit 4
--lm_quant_block 64
--embed_bit 16
--hqq enabled
--seperate_embed enabled

Runtime defaults in config.json: CPU backend, 4 threads, low precision, low memory, separated BF16 embeddings.

Limitations

  • This is a safety-reduced / abliterated model; deploy with appropriate product policy, user controls, and local-law awareness.
  • Large and slow on phones: TokForge runs it on the CPU by default (the GPU route is opt-in), and it is practical only on 24 GB phones.
  • Image input is included in the bundle but was not part of TokForge's device checks.
  • This is a runtime bundle, not a standard Transformers training checkpoint.

License

Apache-2.0, inherited from the upstream Qwen and huihui-ai model cards. See the
Apache License 2.0.

Credits

  • Huihui-Qwen3.6-27B-abliterated by huihui-ai (Hugging Face). Used under the Apache-2.0 license.
  • Qwen3.6-27B by the Qwen team (Alibaba Cloud) (Hugging Face). Used under the Apache-2.0 license.
  • Converted with llmexport from MNN by Alibaba (Apache-2.0).

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-17 Duplicate from darkmaniac7/Huihui-Qwen3.6-27B-abliterated-MNN 2124f1a 6.1 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration