license: apache-2.0
base_model: thinkingmachines/Inkling-2-Mini
pipeline_tag: image-text-to-text
tags:
- gguf
- llama.cpp
- inkling2
- uncensored
- lora
Inkling-2-Mini Uncensored GGUF
- Built by the team behind Atomic Chat, the app that runs open-weight models locally and offline.
An uncensored build of thinkingmachines/Inkling-2-Mini by AtomicChat. The refusal direction is removed from the weights that write into the residual stream. The base model is a 26.4B mixture-of-experts model (3.4B active) with a looped core. It takes text and image input. License: Apache-2.0, the same as the base model (LICENSE in this repo).
Status: in progress. The files will land here: a LoRA adapter for llama.cpp (--lora-scaled) and ready-made GGUF files with the edit already applied. This card will then report the measured results:
refusals before and after;
XSTest (false refusals on safe prompts);
MMLU;
KLD against the original model.
Runtime. The looped Inkling 2 needs llama.cpp with ggml-org/llama.cpp#32695, a draft PR at the time of writing. llama.cpp releases without that PR do not load this model.
Original quants: AtomicChat/Inkling-2-Mini-GGUF.
This model will answer requests that the original refuses. You are responsible for how you use it.



