← back to catalog · registered 2026-08-22 13:56

prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX

prithivMLmods Qwen 27B GGUF multimodal 262K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/prithivMLmods%2FQwen3.5-27B-abliterated-v2-MAX"
Response includes
  • classification m8
  • files 12
  • benchmarks 11 entries
  • hub_downloads_all_time 3,203
  • author_summary 98 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
3K
274 last 30d - cooling
Likes
3
Descendants
4
in 4 direct forks
Model age
6mo ago
created 2026-03-28
Downloads over time
Now3.3K→from119↑2,666%
01.2K2.4K3.6K119 on Apr 13.3K on Oct 11AprMayJunJulAugSepOct
Apr 1 → Oct 11 · 67 snapshots · spans 193 days

Benchmarks

Portrait before abliteration
Benchmarks of the base model as it stood before the refusal-removal operation. Compare with the numbers above to see what the operation cost.
Benchmark Score Source
Entertainment 1 UGI
Hazardous 1.8 UGI
Natural Intelligence 35.83 UGI
Political lean -17.8% UGI
Sensitive-Info 17.72 UGI
SocPol 2.7 UGI
UGI 15.98 UGI
Willingness (10) 1.2 UGI
W10-Adherence 1.5 UGI
W10-Direct 1 UGI
Writing 42.37 UGI

Genealogy 4 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 3 formats · 351 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
apache-2.0
Languages
en
Tags
transformers safetensors gguf qwen3_5 image-text-to-text text-generation-inference uncensored abliterated unfiltered unredacted refusal-ablated vllm

Related

Total size
51.0 GB
Files
12
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-06-01 08:27

Files by quantization

Auxiliary files 12 files 51.0 GB
model-00002-of-00003.safetensors 19.0 GB 8d116a99 download
model-00001-of-00003.safetensors 18.9 GB 1a5653cd download
model-00003-of-00003.safetensors 13.1 GB 2b795425 download
tokenizer.json 19.1 MB 87a7830d download
model.safetensors.index.json 138 KB d752fe0c download
chat_template.jinja 7.57 KB a585dec8 download
README.md 5.15 KB 702a8295 download
config.json 3.55 KB a0e8e33d download
.gitattributes 1.85 KB dc00ab40 download
processor_config.json 1.27 KB 8af8110f download
tokenizer_config.json 1.11 KB 541f6c47 download
generation_config.json 213 B 4c133963 download

README current version from Hugging Face


license: apache-2.0
tags:

  • text-generation-inference
  • uncensored
  • abliterated
  • unfiltered
  • unredacted
  • refusal-ablated
  • vllm
  • pytorch
  • bf16
  • max
  • alignment-modified
  • reasoning
  • llama.cpp
  • llm-compressor
    language:
  • en
    base_model:
  • Qwen/Qwen3.5-27B
    pipeline_tag: image-text-to-text
    library_name: transformers

1

Qwen3.5-27B-abliterated-v2-MAX

Qwen3.5-27B-abliterated-v2-MAX is an optimized release built on top of huihui-ai/Huihui-Qwen3.5-27B-abliterated. This version focuses on improved model sharding, packaging consistency, and compatibility with modern Transformers and inference stacks, while preserving the reasoning and instruction-following capabilities of the base model. The result is a powerful 27B parameter language model designed for stable inference, efficient deployment, and research-oriented experimentation.

[!IMPORTANT]
This model is intended strictly for research and learning purposes. Any outputs generated by this model are the sole responsibility of the user. The authors and hosting platform disclaim all liability for generated content. Users must ensure safe, ethical, and lawful usage.

Compression for the Model

Qwen3.5-27B-abliterated-v2-MAX

Format Description Link
GGUF Quantized GGUF format https://huggingface.co/prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX/tree/main/GGUF
NVFP4 NVFP4 compressed model https://huggingface.co/prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX-NVFP4
FP8 FP8 compressed model https://huggingface.co/prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX-FP8

Base Model Signatures:

This model has been re-sharded and optimized for the latest Transformers version from the base model:
https://huggingface.co/huihui-ai/Huihui-Qwen3.5-27B-abliterated


Key Highlights

  • Optimized Packaging & Sharding
    Improved repository structure for smoother downloads, loading, and deployment workflows.

  • Stable Transformers Compatibility
    Updated configuration for better compatibility with modern Transformers versions and inference runtimes.

  • 27B Parameter Architecture
    Built on Qwen3.5-27B, providing strong reasoning capacity and scalability.

  • Efficient Deployment Design
    Structured for reliable inference across local, cloud, and multi-GPU environments.

  • Preserved Model Behavior
    No changes to weights or architecture; behavior remains consistent with the original base model lineage.

  • Improved Loading Reliability
    Reduced friction in model initialization and distributed inference setups.


Quick Start with Transformers

pip install transformers==5.4.0
# or
pip install git+https://github.com/huggingface/transformers.git
from transformers import Qwen3_5ForConditionalGeneration, AutoProcessor
import torch

model = Qwen3_5ForConditionalGeneration.from_pretrained(
    "prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX",
    torch_dtype="auto",
    device_map="auto"
)

processor = AutoProcessor.from_pretrained(
    "prithivMLmods/Qwen3.5-27B-abliterated-v2-MAX"
)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "text", "text": "Explain how transformer models work in simple terms."}
        ],
    }
]

text = processor.apply_chat_template(
    messages, tokenize=False, add_generation_prompt=True
)

inputs = processor(
    text=[text],
    padding=True,
    return_tensors="pt"
).to("cuda")

generated_ids = model.generate(**inputs, max_new_tokens=256)

generated_ids_trimmed = [
    out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]

output_text = processor.batch_decode(
    generated_ids_trimmed,
    skip_special_tokens=True,
    clean_up_tokenization_spaces=False
)

print(output_text)

Intended Use

  • Multimodal and Language Research
    Studying behavior and scaling properties of 27B transformer models.

  • Red-Teaming & Robustness Evaluation
    Testing model stability under adversarial and complex prompting conditions.

  • High-Performance Deployment
    Running large models on optimized multi-GPU or cloud-based inference systems.

  • Research Prototyping
    Experimentation with transformer architectures and inference optimization techniques.


Limitations & Risks

Important Note: This model inherits behavior from its base model with minimal modification.

  • Output Variability
    Results may vary depending on sampling parameters and prompt structure.

  • Resource Requirements
    A 27B model requires significant GPU memory or optimized inference setups such as quantization or tensor parallelism.

  • Deployment Complexity
    Performance depends heavily on hardware configuration and runtime optimization.

  • General Model Limitations
    May still produce incorrect, incomplete, or inconsistent outputs in complex scenarios.

README history 7 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-06-01Update README.md6a9f8795.1 KB
    Loading...
  2. 2026-06-01Update README.md015314e5 KB
    Loading...
  3. 2026-03-31Update README.md3fb947c4.8 KB
    Loading...
  4. 2026-03-30Update README.md146fe2c4.7 KB
    Loading...
  5. 2026-03-30Update README.mdcdc5e304.6 KB
    Loading...
  6. 2026-03-30Update README.md41fab824.1 KB
    Loading...
  7. 2026-03-28initial commitcdc370d28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration