license: apache-2.0
datasets:
- heretic-org/Semantic-Harmful
- heretic-org/Semantic-Harmless
base_model: - unsloth/Inkling-2-Mini-GGUF
tags: - Abliterated
Inkling-2-Mini-Abliterated-GGUF
In-place abliterated Unsloth Dynamic (UD) GGUF builds of thinkingmachines/Inkling-2-Mini derived directly from unsloth/Inkling-2-Mini-GGUF, preserving every tensor's original UD per-tensor quantization allocation (BF16, Q8_0, Q6_K, Q5_K, Q4_K, Q2_0, NVFP4, MXFP4).
Disclaimer: These weights are uncensored / abliterated for research, red-teaming, and alignment evaluation. Review and adhere to local laws and responsible-use practices.
Available Files
| File | Variant | Quant Type Preservation | File Size | SHA-256 (prefix) |
|---|---|---|---|---|
Inkling-2-Mini-UD-Q8_K_XL-Abliterated.gguf |
UD-Q8_K_XL |
attn_output: 24 BF16 · ffn_down_exps: 20 NVFP4 + 4 BF16 · output.weight: BF16 |
TBD |
TBD |
Inkling-2-Mini-UD-Q4_K_XL-Abliterated.gguf |
UD-Q4_K_XL |
attn_output: 24 Q8_0 · ffn_down_exps: 20 NVFP4 + 4 Q8_0 · output.weight: Q8_0 |
TBD |
TBD |
Inkling-2-Mini-UD-Q4_K_M-Abliterated.gguf |
UD-Q4_K_M |
attn_output: 24 Q8_0 · ffn_down_exps: 20 NVFP4 + 4 Q8_0 · output.weight: Q8_0 |
TBD |
TBD |
Inkling-2-Mini-UD-Q2_K_XL-Abliterated.gguf |
UD-Q2_K_XL |
attn_output: 18 Q8_0 + 1 Q6_K + 5 Q5_K · ffn_down_exps: 12 Q2_0 + 11 NVFP4 + 1 MXFP4 · output.weight: Q4_K |
TBD |
TBD |
mmproj-BF16.gguf |
Vision projector | Unmodified from unsloth/Inkling-2-Mini-GGUF (multimodal support) |
TBD |
TBD |
SHA256SUMS.txt |
Checksums | Full SHA-256 verification list for all artifacts | — | — |
Benchmark
Perplexity
| Model | PPL | ± |
|---|---|---|
| Base | - | |
| Q8_K_XL |
Refusal Evaluation
| Model | Quantization | Refusal |
|---|
Note
Files
| File | Quant | Size |
|---|---|---|
Run