license: other
license_name: minimax-community
license_link: LICENSE
base_model:
- MiniMaxAI/MiniMax-M3.1-Flash
- operationrange/MiniMax-M3.1-Flash-abliterated-GGUF
tags: - gguf
- abliterated
- minimax
- moe
MiniMax-M3.1-Flash abliterated Q3-4
Public copy of a mixed GGUF made so the file can be pulled onto another machine. Q3-4 names the two big expert precisions: routed gate and up are Q3_K, and the down-experts are 4-bit NVFP4 except the abliterated ones, which stay Q6_K. The whole file is 4.31 bits per weight. The MiniMax Community License applies, including its non-commercial terms and prohibited-uses appendix.
Built with MiniMax M3.1-Flash. This is a requantization of operationrange/MiniMax-M3.1-Flash-abliterated-GGUF revision ef198a171043c687a768a4179917ab6547672583. No new abliteration was run. The edited tensors are the ones that repo already stored as Q8_0.
| File | Size |
|---|---|
MiniMax-M3.1-Flash-abliterated-fit256.gguf |
214.03 GiB |
Tensor mix, from that abliterated Q8 file:
blk.16–blk.42ffn_down_exps(the abliterated experts): Q6_K- other routed down-experts: original NVFP4, copied
- routed gate and up experts: Q3_K
- attention Q/K/output, shared expert, dense lead FFN: Q8_0
- attention V, embeddings, output head: BF16
- norms, router, indexer, and per-expert
.scaletensors: copied
The per-expert scale tensors are required. A correct runtime multiplies them after the expert matmul.
hf download choppedgarlic/MiniMax-M3.1-Flash-abliterated-Q3-4 --local-dir ./minimax-q3-4
The model will comply with requests the original refuses. Quality and speed on the M3 Ultra have not been measured yet.