← back to catalog · registered 2026-11-21 09:04

KookiesXy/Inkling-2-Mini-Uncensored-GGUF

KookiesXy GGUF MoE multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/KookiesXy%2FInkling-2-Mini-Uncensored-GGUF"
Response includes
  • classification m-uncensored
  • files 6
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
10
Likes
3
Model age
1d ago
created 2026-11-21
Downloads over time
Now 10 → from 0 ↑ 0%
04711 0 on Nov 21 10 on Nov 22 Nov
Nov 21 → Nov 22 · 2 snapshots · spans 1 day

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Quantizations
Q8_0
Tags
gguf llama.cpp inkling2 uncensored mixture-of-experts image-text-to-text base_model:OpenUncensored/Inkling-2-Mini-Uncensored base_model:quantized:OpenUncensored/Inkling-2-Mini-Uncensored license:apache-2.0 endpoints_compatible region:us conversational

Related

Total size
40.4 GB
Files
6
Quantizations
3
Registered
2026-11-21 09:04
Last updated on HF
2026-11-21 06:33

Files by quantization

Q8_0 2 files 40.4 GB
Inkling-2-Mini-Uncensored-Q8_0.gguf 25.9 GB 903b9f68 download
Inkling-2-Mini-Uncensored-Q4_0-Q8_0.gguf 14.5 GB 87fa0a6c download
BF16 1 file 612 MB
mmproj-Inkling-2-Mini-Uncensored-BF16.gguf 612 MB 3ad1622a download
Auxiliary files 3 files 4.71 KB
README.md 2.70 KB 74908be4 download
.gitattributes 1.71 KB 11f198de download
SHA256SUMS.txt 318 B 639fceee download

README current version from Hugging Face


license: apache-2.0
base_model: OpenUncensored/Inkling-2-Mini-Uncensored
pipeline_tag: image-text-to-text
library_name: gguf
tags:

  • gguf
  • llama.cpp
  • inkling2
  • uncensored
  • mixture-of-experts

Inkling 2 Mini Uncensored GGUF

GGUF conversions of OpenUncensored/Inkling-2-Mini-Uncensored, source revision 748f78ee942acf376d4e11eac92f6c3034c84ddb. The source is an abliterated version of Thinking Machines' Inkling 2 Mini. See the source model card for details and limitations.

File Size Description
Inkling-2-Mini-Uncensored-Q4_0-Q8_0.gguf 15.6 GB Custom hybrid: Q4_0 routed experts, Q8_0 eligible non-expert matrices and F32 sensitive tensors.
Inkling-2-Mini-Uncensored-Q8_0.gguf 27.8 GB Q8_0 eligible matrices, F32 sensitive tensors.
mmproj-Inkling-2-Mini-Uncensored-BF16.gguf 642 MB Vision projector, for image input with either text model.

The hybrid is not Q4_K_M and was not importance-matrix calibrated. The source stores its experts in NVFP4/MXFP8; conversion expands and requantizes them, adding quantization loss. The separate MTP/speculator weights are not included. See SHA256SUMS.txt for file hashes.

Usage

Use an Inkling 2 loop-capable llama.cpp build, such as b12600 or newer. Both text files loaded and generated tokens with b12600. For image input use the matching projector; a CPU llama-server smoke test correctly identified a solid red image. The standalone image CLI crashed on the conversion machine, so use the server path if that occurs. These short tests are not a quality benchmark. The hybrid needs more than 15.6 GB of memory or sufficient swap; Q8_0 requires considerably more.

llama-cli -m Inkling-2-Mini-Uncensored-Q4_0-Q8_0.gguf -p "The capital of France is" -n 16
llama-server -m Inkling-2-Mini-Uncensored-Q4_0-Q8_0.gguf --mmproj mmproj-Inkling-2-Mini-Uncensored-BF16.gguf -c 1024

Conversion and verification

Converted using llama.cpp commit 29b52d398b294509746ec0a3f28948a3107c0213, with its existing Python Q4_0 quantizer applied to routed experts. The source checkpoint SHA-256 was verified before conversion. Both files have the same 704 tensor names and dimensions and the same architecture/tokenizer metadata as the upstream Inkling 2 Mini GGUF. All float values and quantization scales were finite. Full comparisons of the 20 edited attention matrices yielded a worst relative RMSE of 0.00568. Across 144 sampled expert rows per quant, maximum relative RMSE was 0.10031 for the hybrid and 0.00657 for Q8_0. All 422 vision tensors match the upstream BF16 projector byte for byte. These checks do not measure general quality or uncensoring performance.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-21 Add README.md 138823f 2.7 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration