← back to catalog · registered 2026-08-22 13:56

philbert440/Qwen3.6-27B-Uncensored-Aggressive-W4A16-AWQ

philbert440 Qwen 24B multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/philbert440%2FQwen3.6-27B-Uncensored-Aggressive-W4A16-AWQ"
Response includes
  • classification m1
  • files 13
  • hub_downloads_all_time 2,736
  • author_summary 20 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
3K
161 last 30d - cooling
Likes
1
Model age
3mo ago
created 2026-06-25
Downloads over time
Now2.8K→from42↑6,574%
01K2.1K3.1K42 on Jun 242.8K on Oct 11JunJulAugSepOct
Jun 24 → Oct 11 · 55 snapshots · spans 109 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
transformers safetensors qwen3_5 image-text-to-text uncensored abliterated compressed-tensors w4a16 awq vllm mtp conversational

Related

Total size
17.7 GB
Files
13
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-08-15 16:25

Files by quantization

Auxiliary files 13 files 17.7 GB
model.safetensors 17.4 GB fd136b90 download
model-mtp.safetensors 305 MB 67a0e983 download
tokenizer.json 12.2 MB 5f9e4d49 download
model.safetensors.index.json 203 KB a64038a5 download
config.json 20.7 KB e01ce725 download
tokenizer_config.json 16.3 KB 28d96ff3 download
recipe.yaml 11.2 KB 13381849 download
chat_template.jinja 7.58 KB a8755d82 download
README.md 3.38 KB aa16f277 download
.gitattributes 1.53 KB 52373fe2 download
preprocessor_config.json 390 B 2ea84a43 download
video_preprocessor_config.json 385 B 3ba673a5 download
generation_config.json 214 B 8a2e2eff download

README current version from Hugging Face


license: apache-2.0
base_model: philbert440/Qwen3.6-27B-Uncensored-Aggressive
pipeline_tag: image-text-to-text
library_name: transformers
tags:

  • uncensored
  • abliterated
  • compressed-tensors
  • w4a16
  • awq
  • vllm
  • mtp
  • qwen3_5

Qwen3.6 27B Uncensored Aggressive W4A16 AWQ

Flagship uncensored 27B: most open, cleanest calibration, agentic-verified.

Part of the Qwen3.6-27B Uncensored — base collection — abliterated (Heretic) Qwen3.6 vision-language models served on Tesla V100 via 1Cat-vLLM.

What this is

Aggressive — heavy abliteration: the most open tier (openness 0.417, top of the family) with a modest reasoning cost.

W4A16-AWQ — 4-bit weight-only (AWQ, compressed-tensors), FP16 activations. Runs on 1Cat-vLLM's SM70 TurboMind path (Tesla V100) and on stock vLLM (Ampere+).

Base model: philbert440/Qwen3.6-27B-Uncensored-Aggressive

Benchmarks

7-axis battery on 2× V100. Higher is better except Confab (↓). Openness/Confab are small-N probes; gsm8k is n=100.

gsm8k Factual Confab ↓ Openness tok/s (c1)
0.85 1.0 0.0 0.417 58.5

τ-bench (agentic): 0.55.

Serving

# 1Cat-vLLM on 2x Tesla V100 (SM70): W4A16-AWQ + MTP. (Also runs on stock vLLM, Ampere+.)
export VLLM_SM70_FLASH_ATTN_V100=1 VLLM_SM70_QUANT_BACKEND=turbomind
python -m vllm.entrypoints.openai.api_server \
  --model philbert440/Qwen3.6-27B-Uncensored-Aggressive-W4A16-AWQ --trust-remote-code --dtype half \
  --attention-backend FLASH_ATTN_V100 --tensor-parallel-size 2 \
  --kv-cache-dtype fp8_e5m2 --max-num-seqs 6 \
  --speculative-config '{"method":"mtp","num_speculative_tokens":4,"attention_backend":"FLASH_ATTN_V100","draft_sample_method":"greedy"}' \
  --compilation-config '{"cudagraph_mode":"full_and_piecewise","cudagraph_capture_sizes":[1,2,4,8]}'

Openness

Openness profile (honest): abliteration opens up hacking / malware / lock-picking / NSFW / disinformation prompts; weapons, drugs, political persuasion, surveillance, and extremism stay refused across all tiers. "Uncensored" here means cyber/NSFW-permissive, not unconditionally open.

Variants

See the Qwen3.6-27B Uncensored — base collection for all tiers and formats (BF16 / W4A16-AWQ / NVFP4).


Abliteration removes safety refusals; you are responsible for lawful, ethical use.

Changelog

  • 2026-08-15 — tokenizer fix. tokenizer.json / tokenizer_config.json were re-serialized by the llm-compressor calibration run and shipped with an active truncation block (max_length 1024/2048) plus a drifted pre-tokenizer regex (and, on the Qwen3.6-based repos, 7 phantom audio/TTS special tokens the base model does not define). That broke image inputs larger than the limit under transformers 5 / vLLM (Mismatch in image token count, surfacing as an HTTP 400 Failed to apply Qwen3VLProcessor). Both files are now byte-identical to the upstream base model's (vocab/merges/added tokens were always identical — this is a metadata-only restore). If you downloaded before this date, re-fetch those two files. Thanks to @elBuffo for the report.

README history 5 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-08-15Fix tokenizer: drop leftover truncation block, restore upstream tokenizer.jso...32666df3.4 KB
    Loading...
  2. 2026-08-03Standardize model cardcc903212.6 KB
    Loading...
  3. 2026-06-28Serving card: e5m2/262k + MTP K=2 recommended config; reference 1Cat-vLLM PR ...9c94c1b3.3 KB
    Loading...
  4. 2026-06-28Fix MTP head: packed W4A16 (was bf16) + mtp.fc in ignore -> 80% accept on SM7...4b787673.4 KB
    Loading...
  5. 2026-06-25upload uncensored Qwen3.6-27B8a77d821.1 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration