← back to catalog · registered 2026-11-21 22:04

Kolol205/Inkling-2-Mini-Uncensored-GGUF

Kolol205 GGUF multimodal
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Kolol205%2FInkling-2-Mini-Uncensored-GGUF"
Response includes
  • classification m-uncensored
  • files 9
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-11-21
Downloads over time
Now 0 → from 0 ↑ 0%
0011 0 on Nov 21 0 on Nov 22 Nov
Nov 21 → Nov 22 · 2 snapshots · spans 1 day

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Quantizations
IQ2 IQ3 Q4_K
Tags
gguf llama.cpp inkling2 uncensored lora image-text-to-text base_model:thinkingmachines/Inkling-2-Mini base_model:adapter:thinkingmachines/Inkling-2-Mini license:apache-2.0 endpoints_compatible region:us imatrix

Related

Total size
35.9 GB
Files
9
Quantizations
7
Registered
2026-11-21 22:04
Last updated on HF
2026-11-21 21:25

Files by quantization

Q4_K 1 file 15.4 GB
Inkling-2-Mini-Uncensored-AD-Q4_K.gguf 15.4 GB 36e99f1f download
IQ3 1 file 12.4 GB
Inkling-2-Mini-Uncensored-AD-IQ3_S.gguf 12.4 GB 23a8e679 download
IQ2 1 file 8.07 GB
Inkling-2-Mini-Uncensored-AD-IQ2_M.gguf 8.07 GB fca99d48 download
Drafts and companions 1 file 41.8 MB
Inkling-2-Mini-Uncensored-LoRA.gguf 41.8 MB 42914b85 download
BF16 1 file 612 MB
mmproj-Inkling-2-Mini-Uncensored-BF16.gguf 612 MB 7dd7fd3a download
F16 1 file 610 MB
mmproj-Inkling-2-Mini-Uncensored-F16.gguf 610 MB 5a72e0b6 download
Auxiliary files 3 files 20.6 KB
LICENSE 11.1 KB d6456956 download
README.md 7.61 KB f845c484 download
.gitattributes 1.93 KB 26952400 download

README current version from Hugging Face


license: apache-2.0
base_model: thinkingmachines/Inkling-2-Mini
pipeline_tag: image-text-to-text
tags:

  • gguf
  • llama.cpp
  • inkling2
  • uncensored
  • lora

Inkling-2-Mini Uncensored GGUF

Atomic Chat Discord GitHub X
  • Learn how to run Inkling 2 Mini Uncensored locally - read our guide.
  • Built by the team behind Atomic Chat, the app that runs open-weight models locally and offline.

An uncensored build of thinkingmachines/Inkling-2-Mini by AtomicChat (26.4B MoE, 3.4B active, looped core; text and image input; Apache-2.0, LICENSE in this repo). It comes as a LoRA adapter for any GGUF of AtomicChat/Inkling-2-Mini-GGUF and as three ready-made GGUF files with the edit baked in. Every gate we hold it to is measured below, and the two it misses are shown.

Files

file GB on disk KLD to the original BF16 top-1
Inkling-2-Mini-Uncensored-AD-Q4_K.gguf 16.53 0.0115 95.6% AD-Q4_K in the base repo: 0.0080 / 96.3%
Inkling-2-Mini-Uncensored-AD-IQ3_S.gguf 13.34 0.0235 93.8% AD-IQ3_S in the base repo: 0.0205 / 94.2%
Inkling-2-Mini-Uncensored-AD-IQ2_M.gguf 8.67 0.132 85.7% AD-IQ2_M in the base repo: 0.130 / 85.7%
Inkling-2-Mini-Uncensored-LoRA.gguf 0.04 the adapter, for any GGUF of the base repo, BF16 to 1-bit
mmproj-Inkling-2-Mini-Uncensored-F16.gguf / -BF16.gguf 0.64 vision projector (the original's, unchanged)

KLD and top-1 are against the original BF16 on our neutral corpus (87 chunks of 4096 tokens), the same stand as the base repo.

Run it

The current GGUF files in this repository use the merged Inkling 2 loop architecture introduced in llama.cpp PR #32694.

Requirements: llama.cpp b12600 or newer, with Inkling 2 loop architecture support.

The old implementation from PR #32695 is no longer required for the updated GGUF files.

Run a baked GGUF

./build/bin/llama-server \
    -m Inkling-2-Mini-Uncensored-AD-Q4_K.gguf \
    --mmproj mmproj-Inkling-2-Mini-Uncensored-F16.gguf \
    --jinja -c 32768 -ngl 99

Use the LoRA adapter

Use the updated LoRA adapter with a compatible base GGUF converted to the merged PR #32694 layout.

./build/bin/llama-server \
    -m Inkling-2-Mini-AD-Q4_K.gguf \
    --lora Inkling-2-Mini-Uncensored-LoRA.gguf \
    --mmproj mmproj-Inkling-2-Mini-F16.gguf \
    --jinja -c 32768 -ngl 99

Do not mix GGUF files from the old PR #32695 layout with the merged PR #32694 implementation.

What the edit is

A rank-1 LoRA on the 49 places that write into the residual stream: the attention output and the routed experts of all 24 layers, plus the token embedding. The 12 looped layers share their weights across the three passes, so one edit covers all 48 passes.

In each layer it removes that layer's own refusal direction: the difference of mean activations on harmful and harmless prompts, English and Russian, with the harmless mean projected out. The direction is pooled over prompts rendered with and without reasoning. Inkling 2 Mini reasons even at effort none and decides to refuse inside its reasoning, and a direction taken without reasoning alone still left soft refusals in chat.

What we measured

The BF16 model with the adapter against the same model without it, greedy decoding. Harmful prompts: mlabonne/harmful_behaviors and its Russian translation; the adapter was built from the train split, the numbers below come from the validation and test splits. Over-refusal: XSTest. MMLU: 2,000 questions.

check original with the adapter gate
harmful test prompts refused, English (81), reasoning off 81 (100%) 0 at most 3% pass
harmful test prompts refused, Russian (100), reasoning off 91 (91%) 0 at most 3% pass
harmful validation prompts refused, English (104) / Russian (100) 100% / 89% 0 / 0 at most 3% pass
harmful prompts refused with reasoning, effort low, 3,072-token budget (30) 28 0 at most 1 pass
the same at effort high (30) 26 0 at most 1 pass
8 harmful chat prompts, effort none / low (the baked AD-Q4_K too) 8 / 8 0 / 0
XSTest safe prompts refused (250) 10 (4.0%) 0 at most the original's + 1 pt pass
empty answers 0 0 at most 1% pass
harmless prompts whose reasoning did not close in 3,072 tokens, effort high (30) 2 2 at most the original's pass
valid tool calls (20) 18 20 within 1 pass
needle in a long context (3) 3 3 as the original pass
KLD to the original, neutral text / code (24 chunks; random edit 0.0067 / 0.0052) — 0.0078 / 0.0076 0.05 pass
MMLU, 2,000 questions 80.65% 79.15% (−1.50 pt, McNemar p = 0.006) no significant drop miss
first-token KL on harmless test prompts — 0.94 (random edit: 0.014) 0.10 miss

Some answers still open with a caution line, and then answer.

The two gates it misses

  • MMLU: 79.15% against 80.65% (−1.5 points, p = 0.006 on 2,000 questions). A random direction applied the same way costs 0.75 points (p = 0.08), so about half of the loss comes from editing every writer at all. Stronger edits cost more: −2.2 points at strength 1.25.
  • First-token KL on harmless prompts: 0.94 (gate 0.10; 0.375 on the validation prompts). The largest single value is about 22. Most of the mean likely comes from the harmless prompts the original refused (1–6% of them) and the adapter answers, where the first token changes completely. KLD on running text, where refusals play no part, stays at 0.008.
  • The leak probe reads 0.11 against its gate of 0.001. It measures one direction (row 29's) in every writer, while this adapter removes each layer's own direction. It also cannot be exact here: the attention and expert outputs pass a short per-channel convolution before the residual. Removing the convolved directions as well (the exact projection) broke the model in our tests (first-token KL 16–21), so the adapter removes the plain direction. It is no gate here.

This model will answer requests that the original refuses. You are responsible for how you use it.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-21 Duplicate from AtomicChat/Inkling-2-Mini-Uncensored-GGUF a0905a9 7.6 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration