license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated
pipeline_tag: image-text-to-text
library_name: finchmoe
tags:

• finch
• finchmoe
• qwen3.6
• qwen
• moe
• quantized
• vision
• image-text-to-text
• 3-bit
• abliterated

Qwen3.6-35B-A3B Abliterated — FinchMoE 3-bit routed experts + vision payload

This repository holds a .finch install for the out-of-core
FinchMoE engine and its Mac/iOS apps —
not a Transformers checkpoint. It is the Qwen3.6-35B-A3B checkpoint repacked with
routed experts at 3-bit, with the source vision tower carried along.

• Source: huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated at the BF16 snapshot recorded below.
• Text body: attention / GDN / shared experts at 4-bit, linear attention and router at 8-bit, embeddings at 4-bit; routed experts 3-bit affine
  (group 64, BF16 scales/biases).
• Vision: the source model.visual.* tower — 333 BF16 tensors,
  851.8 MiB — copied byte-for-byte into vision/vision.safetensors,
  with the source config and preprocessor sidecars. The FinchMoE vision runtime
  consumes it; text-only consumers can ignore it.
• Text identity: the text bytes are the same recipe as the published text
  sibling haihengh/Qwen3.6-35B-A3B-finch-3bit-abliterated; this
  repository adds the vision payload only.

Artifact facts

File layout

manifest.json                     file set, sizes, SHA-256, architecture, quantization
model_weights.bin                 resident weights
packed_experts/layout.json        expert tensor map (21.4 MiB)
packed_experts/layer_XX.bin       one routed-expert pool per layer
tokenizer/                        tokenizer.json, config, merges, vocab, chat template
vision/model_config.json                      3686 B  source vision tower and configs
vision/preprocessor_config.json                390 B  source vision tower and configs
vision/video_preprocessor_config.json          385 B  source vision tower and configs
vision/vision.safetensors                  851.8 MiB  source vision tower and configs

The 3.6 repositories deliberately omit verified-install.json: that receipt
records the physical directory it was generated for, so a published copy
would not validate elsewhere; the installer writes its own after verifying
every file against manifest.json.

Quality and performance

This variant is not separately measured. Its text weights are the same recipe
as haihengh/Qwen3.6-35B-A3B-finch-3bit-abliterated; use that card
for the measured quality and throughput of the text path. The vision tower adds
about 851.8 MiB of BF16 weights, mapped only while an image is being
encoded.

Usage

FinchMoECLI --model /path/to/Qwen3.6-35B-A3B-abliterated-3bit-vision.finch \
            --messages-file messages.json --max-new 128

The Mac/iOS app needs a vision-capable model row for image turns; a text-only
row will reject the vision/ directory rather than silently ignore it. Until
this repository is added to the app's picker, use the CLI or point the app at
the directory directly.

Provenance

Repacked with FinchMoERepack on 2026-10-28:

FinchMoERepack --input-snapshot <Qwen3.6-35B-A3B-bf16> \
  --output Qwen3.6-35B-A3B-abliterated-3bit-vision.finch --routed-expert-bits 3 --include-vision

The source snapshot hash is recorded in the manifest above. The abliteration,
where applicable, was done upstream (huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated); this repository changes
only the container, the quantization, and the added vision payload.

License

See LICENSE. Weights are derived from the upstream model named in
base_model; this repository is a derivative work.