← back to catalog · registered 2026-11-05 18:02

chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized

chatrlabs Qwen GGUF image-gen
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/chatrlabs%2FQwen-Image-2.1-Uncensored-Omni-Quantized"
Response includes
  • classification m-uncensored
  • files 14
  • author_summary 7 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
4K
Likes
27
Model age
3d ago
created 2026-11-03
Downloads over time
Now0→from0↑0%
00110 on Nov 50 on Nov 6Nov
Nov 5 → Nov 6 · 2 snapshots · spans 1 day

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Quantizations
BF16 Q4 Q4_K Q5_K Q6_K Q8_0
Tags
diffusers safetensors gguf qwen-image qwen-image-2.1 text-to-image image-editing fp8 int8 nvfp4 nf4 quantized

Related

Total size
56.2 GB
Files
14
Quantizations
7
Registered
2026-11-05 18:02
Last updated on HF
2026-11-05 08:30

Files by quantization

BF16 1 file 13.3 GB
qwen-image-2.1-step90000-BF16.gguf 13.3 GB 027501fd download
Q8_0 1 file 7.16 GB
qwen-image-2.1-step90000-Q8_0.gguf 7.16 GB 58ab4d7b download
Q6_K 1 file 5.59 GB
qwen-image-2.1-step90000-Q6_K.gguf 5.59 GB 8502230f download
Q5_K 1 file 4.85 GB
qwen-image-2.1-step90000-Q5_K_M.gguf 4.85 GB 5f577a47 download
Q4_K 1 file 4.17 GB
qwen-image-2.1-step90000-Q4_K_M.gguf 4.17 GB 05be65de download
Q4 1 file 3.91 GB
qwen-image-2.1-step90000-Q4_0.gguf 3.91 GB 8fa0b4e2 download
Auxiliary files 8 files 17.3 GB
qwen-image-2.1-step90000-INT8-ConvRot-comfy.safetensors 6.76 GB 90ad49ec download
qwen-image-2.1-step90000-FP8-comfy.safetensors 6.63 GB ff341f94 download
qwen-image-2.1-step90000-NVFP4-comfy.safetensors 3.91 GB e6e2ff44 download
README.md 9.71 KB b3251a09 download
LICENSE 7.65 KB 13ae08d5 download
.gitattributes 1.90 KB 701f6eb5 download
SHA256SUMS 1.47 KB ee104263 download
Notice 640 B 7f2543cd download

README current version from Hugging Face


license: other
license_name: qwen-research
license_link: LICENSE
base_model:

  • Qwen/Qwen-Image-2.1
    base_model_relation: quantized
    pipeline_tag: text-to-image
    library_name: diffusers
    tags:
  • qwen-image
  • qwen-image-2.1
  • text-to-image
  • image-editing
  • gguf
  • fp8
  • int8
  • nvfp4
  • nf4
  • quantized
  • comfyui
  • diffusers
  • uncensored

ChatR Labs Uncensored Omni — Quantized

Try the Playground
Base model

Quantized builds at adapter weight 1.0, for text-to-image generation and image editing.

This repository ships quantized transformer weights only. The model is our rank-128 Omni adapter merged into
Qwen/Qwen-Image-2.1 at LoRA strength 1.0, then quantized.
The text encoder, processor and VAE are not included; take them from the base repository.

Download

File Format Layout Size Runtime
qwen-image-2.1-step90000-BF16.gguf GGUF BF16 297 14.23 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-Q8_0.gguf GGUF Q8_0 297 7.69 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-Q6_K.gguf GGUF Q6_K 297 6.00 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-Q5_K_M.gguf GGUF Q5_K_M 297 5.21 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-Q4_K_M.gguf GGUF Q4_K_M 297 4.47 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-Q4_0.gguf GGUF Q4_0 297 4.20 GB ComfyUI, Diffusers
qwen-image-2.1-step90000-FP8-comfy.safetensors FP8 E4M3 265 7.12 GB ComfyUI only
qwen-image-2.1-step90000-INT8-ConvRot-comfy.safetensors INT8 ConvRot 265 7.26 GB ComfyUI only
qwen-image-2.1-step90000-NVFP4-comfy.safetensors NVFP4 265 4.20 GB ComfyUI only
qwen-image-2.1-step90000-FP8-torchao/ FP8 (torchao) 297 7.12 GB Diffusers only
qwen-image-2.1-step90000-NF4-bnb/ NF4 (bitsandbytes) 297 3.67 GB Diffusers only
qwen-image-2.1-step90000-INT8-bnb/ INT8 (bitsandbytes) 297 7.12 GB Diffusers only
qwen-image-2.1-step90000-BF16/ BF16 safetensors 297 14.23 GB Diffusers only

File integrity information is in SHA256SUMS.

Which build should I use?

  • ComfyUI, one file, both workflows -> any GGUF. It also loads in Diffusers via from_single_file.
  • ComfyUI, native quant ops -> FP8, INT8 ConvRot or NVFP4.
  • Diffusers, smallest download -> NF4 (needs bitsandbytes).
  • Diffusers, best fidelity -> FP8 (torchao) (needs torchao).
  • Maximum fidelity overall -> BF16 GGUF, BF16 safetensors or Q8_0.
  • Diffusers without the gguf package -> the BF16 folder (plain from_pretrained).

The 297 and 265 layouts are not interchangeable. 265 uses the fused img_mlp.gate_up projection ComfyUI
expects; 297 keeps the separate gate_layer / proj pair Diffusers expects. Loading a 265 file in Diffusers,
or a 297 Diffusers-layout file through ComfyUI's native loader, will fail.

Recommended settings

These are the values from our inference grid search for the non-distilled model.

Setting Starting value
Base components Text encoder, processor and VAE from Qwen/Qwen-Image-2.1
Sampling steps 35
True CFG scale 5.0 (both text-to-image and editing)
Sampler er_sde with the simple scheduler (ComfyUI)
Negative prompt A single space: " "
Output resolution 768 x 1152 or 1024 x 1024
KV cache Enabled

An omitted or empty negative prompt disables true CFG even when true_cfg_scale is greater than 1. Use a single
space if you do not need a specific negative prompt. This is a regular LoRA merge; it does not provide few-step
distillation.

Usage with ComfyUI

ComfyUI/models/
|-- diffusion_models/    qwen-image-2.1-step90000-Q5_K_M.gguf
|-- text_encoders/       <Qwen-Image-2.1 text encoder>
`-- vae/                 <Qwen-Image-2.1 VAE>
  • GGUF: Unet Loader (GGUF) -> pick the file. Works for both text-to-image and editing.
  • Comfy native: Load Diffusion Model -> pick a -comfy.safetensors file.
  • Editing: encode the reference image with Text Encoder (Qwen-Image) in edit mode; the latent comes from that node.
  • Sampler: er_sde, scheduler simple, 35 steps, CFG 5.0.

Usage with Diffusers

GGUF

import torch
from diffusers import QwenImage21Pipeline, QwenImage21Transformer2DModel, GGUFQuantizationConfig

transformer = QwenImage21Transformer2DModel.from_single_file(
    "qwen-image-2.1-step90000-Q5_K_M.gguf",
    quantization_config=GGUFQuantizationConfig(compute_dtype=torch.bfloat16),
    config="Qwen/Qwen-Image-2.1",
    subfolder="transformer",
    torch_dtype=torch.bfloat16,
)
pipe = QwenImage21Pipeline.from_pretrained(
    "Qwen/Qwen-Image-2.1", transformer=transformer, torch_dtype=torch.bfloat16,
)
pipe.enable_model_cpu_offload()

FP8 / NF4 / INT8 folders

import torch
from diffusers import QwenImage21Pipeline, QwenImage21Transformer2DModel

transformer = QwenImage21Transformer2DModel.from_pretrained(
    "chatrlabs/Qwen-Image-2.1-Uncensored-Omni-Quantized",
    subfolder="qwen-image-2.1-step90000-FP8-torchao",
    torch_dtype=torch.bfloat16,
)
pipe = QwenImage21Pipeline.from_pretrained(
    "Qwen/Qwen-Image-2.1", transformer=transformer, torch_dtype=torch.bfloat16,
)

The INT8 build stores its non-quantized tensors in FP16, so load both the transformer and the pipeline with
torch_dtype=torch.float16.

Text to image

image = pipe(
    prompt="A blue ceramic mug on a wooden table by a window, soft morning light, product photography",
    negative_prompt=" ",
    width=1024,
    height=1024,
    num_inference_steps=35,
    true_cfg_scale=5.0,
    use_kv_cache=True,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]
image.save("generated.png")

Image editing

from PIL import Image

reference = Image.open("generated.png").convert("RGBA")
image = pipe(
    image=[reference],
    prompt="Change the mug to green, keep everything else unchanged",
    negative_prompt=" ",
    width=1024,
    height=1024,
    output_resolution=1024,
    num_inference_steps=35,
    true_cfg_scale=5.0,
    use_kv_cache=True,
    generator=torch.Generator("cuda").manual_seed(45),
).images[0]
image.save("edited.png")

Keep VAE tiling off: tiled decoding adds visible vertical colour streaks.

Memory and performance

Measured on a single RTX 5090 (32 GB), 35 steps, er_sde, 768 x 1152:

Build Peak VRAM Time per image (text to image) Time per image (edit)
BF16 ~14 GB ~28 s ~32 s
Q5_K_M ~8 GB ~28 s ~32 s
NVFP4 ~4 GB ~30 s ~34 s

Editing and ControlNet runs add reference and control latents; budget a few GB more. The BF16 pipeline does not
fit comfortably beside a full text encoder on a 24 GB card - use CPU offload there.

These are individual timings, not comparative quality benchmarks.

Quantization details

Property Value
Base Qwen-Image-2.1
Adapter ChatR Labs rank-128 Omni LoRA, merged at strength 1.0
Training checkpoint Step 90000
Adapted modules 224
Diffusers-layout tensors 297
Comfy-layout tensors 265
GGUF tool ComfyUI-GGUF convert.py, per-block quantization
Comfy FP8 TensorCoreFP8E4M3Layout, per-tensor scale, 229 modules
Comfy INT8 ConvRot convrot, group size 256, 224 modules
Comfy NVFP4 TensorCoreNVFP4Layout, 192 fused modules
Diffusers FP8 torchao Float8WeightOnlyConfig, per-row scale
Diffusers NF4 bitsandbytes 4-bit NF4 with double quantization
Diffusers INT8 bitsandbytes 8-bit

The text encoder and VAE are untouched in every build; differences between builds come from the transformer only.

About "uncensored"

The checkpoints and example code do not add a prompt filter or output safety checker. The name describes the
intended release, not a guarantee that every requested concept will be rendered. Results depend on the prompt,
the build you load, and the application running it.

Source and license

  • Released by: ChatR Labs
  • Base model: Qwen/Qwen-Image-2.1
  • Modification: ChatR Labs merged a rank-128 adapter into the base transformer at strength 1.0 and produced
    GGUF, FP8, INT8, NVFP4 and NF4 builds. This repository distributes quantized transformer weights only.
  • License: Qwen Research License Agreement. Use is limited to non-commercial research and
    evaluation unless separately licensed by the upstream rights holder.
  • Checksums: SHA256SUMS

Built with Qwen. This is a community fine-tune by ChatR Labs, independent of the upstream Qwen team.

Infrastructure Support

GPU compute used for the development and evaluation of this release was provided by Chatr AI.

We thank the Chatr AI team for supporting this research release.

README history 7 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-05Upload README.md with huggingface_hub0c62c3f9.7 KB
    Loading...
  2. 2026-11-05Improve model card SEO and release detailsaf9956310.4 KB
    Loading...
  3. 2026-11-05Upload README.md with huggingface_hub04077c79.5 KB
    Loading...
  4. 2026-11-04Upload README.md with huggingface_hub3a2e8059.4 KB
    Loading...
  5. 2026-11-04Upload README.md with huggingface_huba0f0ebb9.4 KB
    Loading...
  6. 2026-11-04Upload README.md with huggingface_hub9faee6c9.4 KB
    Loading...
  7. 2026-11-03Upload README.md with huggingface_hub3e247bd9.6 KB
    Loading...

Discussions 2 threads

  1. 2026-11-05LoRaopen1 💬#2
    Loading...
  2. 2026-11-05more pleaseopen1 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration