← back to catalog · registered 2026-11-13 22:03

Austriani/MiMo-V2.6-Distill-Qwen-9B-ARA-Abliterated-ik_llama.cpp

Austriani Qwen 9B GGUF multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Austriani%2FMiMo-V2.6-Distill-Qwen-9B-ARA-Abliterated-ik_llama.cpp"
Response includes
  • classification m8
  • files 9
  • author_summary 13 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
2K
Likes
1
Model age
1w ago
created 2026-11-13
Downloads over time
Now 1.7K → from 0 ↑ 0%
06391.3K1.9K 0 on Nov 13 1.7K on Nov 22 Nov
Nov 13 → Nov 22 · 10 snapshots · spans 9 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en
Tags
ik_llama.cpp gguf mimo mimo-v2.6 qwen3.5 9b agentic abliterated uncensored decensored nsfw ara

Related

Total size
29.8 GB
Files
9
Quantizations
1
Registered
2026-11-13 22:03
Last updated on HF
2026-11-13 21:58

Files by quantization

Auxiliary files 9 files 29.8 GB
MiMo-9B-Heretic-IQ5_K.gguf 5.87 GB ee7fcc43 download
MiMo-9B-Heretic-MaxOptima.gguf 4.98 GB b2b3689d download
MiMo-9B-Heretic-IQ4_K.gguf 4.95 GB ec705964 download
MiMo-9B-Heretic-IQ4_KS.gguf 4.73 GB a6f0b6f2 download
MiMo-9B-Heretic-IQ4_KS_R4.gguf 4.73 GB 74f54105 download
MiMo-9B-Heretic-IQ4_KT.gguf 4.50 GB 2fbb922f download
MiMo-9B-Heretic.imatrix 4.38 MB 3d189ce1 download
README.md 14.8 KB 06d4a368 download
.gitattributes 1.92 KB 3fc0143a download

README current version from Hugging Face


license: apache-2.0
base_model: Austriani/MiMo-V2.6-Distill-Qwen-9B-ARA-Abliterated
pipeline_tag: text-generation
library_name: ik_llama.cpp
language:

  • en
    tags:
    • mimo
    • mimo-v2.6
    • qwen3.5
    • 9b
    • agentic
    • abliterated
    • uncensored
    • decensored
    • nsfw
    • ara
    • arbitrary-rank-ablation
    • heretic
    • refusal-removed
    • ik-llama.cpp
    • iqk
    • trellis-quant
    • maxoptima
    • gguf
    • quantized
    • imatrix
    • v3-calibration
    • vision
    • multimodal
    • code
    • cybersecurity
    • tool-use
    • long-context
    • austriani

Austriani // ik_llama.cpp // GGUF

MiMo V2.6 9B
ARA Abliterated

IQK Quantization // V3 Calibration // 262K Context
9B
Parameters
262K
Native Context
1024
Imatrix Ctx
500
Cycles
The Base Model
This repository hosts ik_llama.cpp-compatible GGUF quantizations of MiMo-V2.6-Distill-Qwen-9B, abliterated with the ARA method. The parent is a 9-billion-parameter agentic model built by Xiaomi MiMo via supervised fine-tuning of Qwen3.5-9B on MiMo-generated data spanning software engineering, terminal tool-use, visual coding, and cybersecurity.
Architecturally, it inherits the Qwen3.5 hybrid attention stack: 24 gated DeltaNet linear-attention layers interleaved with 8 full-attention layers across 32 blocks (full attention every 4th layer). The linear layers carry a fixed-size recurrent state instead of a growing KV cache, which keeps memory growth flat at long context. A vision encoder feeds image tokens into the same text backbone.
Quantizing a hybrid stack is not the same as quantizing a dense transformer. The delta-net recurrence parameters (conv1d, ssm_a, ssm_dt.bias) are held at full precision in every build here — they are small tensors with outsized influence on state drift, and quantizing them breaks long-context coherence before it shows up in perplexity.
MaxOptima Custom Quant
This release includes MaxOptima, a layer-aware mix built for the Qwen3.5 delta-net geometry. The strategy splits into two tracks: the SSM / linear-attention path keeps its recurrence and normalization tensors at F32, while the 8 full-attention layers (3, 7, 11, 15, 19, 23, 27, 31) — the only layers that carry a real KV cache — get higher-precision projections because they are the ones holding the long-range context together.
MaxOptima strategy: Embeddings and output locked at Q6_K. All delta-net recurrence and norm tensors (conv1d, ssm_a, ssm_dt.bias, attn/ssm/output norms) held at F32. Boundary blocks 0 and 31 get protected SSM-out, QKV, gate, and FFN tensors. Full-attention layers get Q6_K on V and output, Q5_K on Q and K. Mid-stack SSM-out and QKV use IQ5_K. Gates compress to IQ3_KS; FFN up/down to IQ4_KSS. Default fallback is Q5_K.
View Full MaxOptima Custom Quant Configuration
^token_embd\.weight=Q6_K,^output\.weight=Q6_K,.*conv1d\.weight=F32,.*ssm_a=F32,.*ssm_dt\.bias=F32,.*\.(attn_norm|post_attention_norm|attn_q_norm|attn_k_norm|ssm_norm|output_norm)\.weight=F32,blk\.0\.ssm_out\.weight=Q8_0,blk\.0\.attn_qkv\.weight=Q6_K,blk\.0\.attn_gate\.weight=Q6_K,blk\.0\.ffn_up\.weight=Q5_K,blk\.0\.ffn_down\.weight=Q5_K,blk\.31\.ffn_up\.weight=Q5_K,blk\.31\.ffn_down\.weight=Q5_K,blk\.(3|7|11|15|19|23|27|31)\.attn_v\.weight=Q6_K,blk\.(3|7|11|15|19|23|27|31)\.attn_output\.weight=Q6_K,blk\.(3|7|11|15|19|23|27|31)\.attn_k\.weight=Q5_K,blk\.(3|7|11|15|19|23|27|31)\.attn_q\.weight=Q5_K,blk\..*\.ssm_out\.weight=IQ5_K,blk\..*\.attn_qkv\.weight=IQ5_K,blk\..*\.attn_gate\.weight=IQ3_KS,blk\..*\.ffn_gate\.weight=IQ3_KS,blk\..*\.ffn_up\.weight=IQ4_KSS,blk\..*\.ffn_down\.weight=IQ4_KSS,.*=Q5_K
Available Quants
MaxOptima // Custom Hybrid Mix
MaxOptima
Custom layer-aware mix. F32 on the delta-net recurrence path, Q6_K full-attention V/output, IQ5_K mid-stack SSM-out and QKV, IQ3_KS gates, IQ4_KSS FFN. The recommended build for this model.
Standard IQK // High & Mid Fidelity
IQ5_K
Higher fidelity 5-bit. Best quality-to-size for systems with sufficient memory.
IQ4_K
Standard 4-bit IQK. Uses 256-value super-blocks for scaling.
IQ4_KS
"Small" 4-bit variant with tighter packing. Lower memory footprint.
IQ4_KS_R4
Row-interleaved variant of IQ4_KS, optimized for ik_llama.cpp's matmul kernels.
Trellis // Alternative 4-Bit
IQ4_KT
Dynamic programming trellis quant. Uses a fundamentally different error-minimization strategy than IQK.
Abliteration Report // ARA Method
The base abliteration uses Arbitrary-Rank Ablation (ARA) via Heretic, across layers 7 through 29 — the middle-to-late blocks where refusal directions concentrate in the Qwen3.5 hybrid stack. The run settled on trial 18 of 40, with a measured refusal rate of 42/100 and a KL divergence of 0.3377.
Run metrics, not guarantees. A 42% refusal rate means refusals are reduced, not eliminated. KL divergence of 0.3377 is moderate — validate capability retention on your own tasks. These quants preserve the abliterated weights as-is; behaviour is inherited from the parent checkpoint.
View Full ARA Parameters
start_layer_index
7
end_layer_index
29
preserve_good_behavior_weight
0.5826
steer_bad_behavior_weight
0.0465
overcorrect_relative_weight
0.8496
neighbor_count
9
trial
18 / 40
refusals
42 / 100
KL divergence
0.3377
Imatrix Specification
This release uses the V3 Calibration Dataset used across previous Austriani releases. Calibration ran at 500 cycles per chunk with a 1024-token context window, processing approximately 1000 chunks.
Compatibility
These GGUF files are built exclusively for ik_llama.cpp. IQK, Trellis, and MaxOptima quants will not load in mainline llama.cpp. The hybrid delta-net architecture also requires a build recent enough to carry Qwen3.5 linear-attention support — older ik_llama.cpp builds will fail on the SSM blocks regardless of quant format.
Vision: the multimodal projector is included, but image input through ik_llama.cpp depends on your build's mmproj support for this architecture. Test before relying on it.

README history 3 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-13 Update README.md 850de5c 14.8 KB
    Loading...
  2. 2026-11-13 Update README.md ec9430c 14.8 KB
    Loading...
  3. 2026-11-13 initial commit ee46947 28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration