Get the app
← back to catalog · registered 2026-08-22 13:56

DevQuasar/huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF

DevQuasar Qwen 500M GGUF second-order 33K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/DevQuasar%2Fhuihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF"
Response includes
  • classification m8
  • files 13
  • hub_downloads_all_time 1,956
  • author_summary 54 models
  • readme_text full
Try next
GET/models?author=DevQuasar
All 54 models by DevQuasar
 GET/models?family=qwen&method=m8
Sibling qwen models · same method
 GET/methods/m8
What "m8" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
M1 Direct removal →
Why this label 3 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=devquasar (M8 quantization producer)
  • is_gguf=1
  • base_model='huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3' looks abliterated -> assume M1
How we label → About M8 →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
2K
527 last 30d - stable
Likes
0
Model age
17mo ago
created 2025-04-30
Downloads over time
Now2.1K→from147↑1,346%
488071.6K2.3K147 on Apr 30, 20252.1K on Oct 11Apr '25Jul '25Oct '25JanAprJulOct
Apr 30, 2025 → Oct 11 · 115 snapshots · spans 529 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3↓ 1,039 this lineage
DevQuasar/huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF↓ 527

Metadata

Quantizations
F16 Q2_K Q3_K Q4_K Q5_K Q6_K Q8_0
Tags
gguf text-generation base_model:huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3 base_model:quantized:huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3 endpoints_compatible region:us conversational

Related

Other by DevQuasar
huihui-ai.Qwen3-8B-abliterated-GGUF 4K huihui-ai.GLM-4-32B-0414-abliterated-GGUF 2K nicoboss.Qwen3-32B-Uncensored-GGUF 2K huihui-ai.Huihui-Qwen3.5-27B-abliterated-GGUF 1K DavidAU.L3.1-Dark-Reasoning-LewdPlay-evo-Hermes-R1-Uncensored-8B-GGUF 1K
Same base model
mradermacher/Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF 845 mradermacher/Qwen2.5-0.5B-Instruct-abliterated-v3-i1-GGUF 737 featherless-ai-quants/huihui-ai-Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF 598 3MPER0RR/Qwen2.5-0.5B-Instruct-3MPER0RR-abliterated 362 onnx-community/Qwen2.5-0.5B-Instruct-abliterated-v3-ONNX 359
Total size
4.70 GB
Files
13
Quantizations
8
Registered
2026-08-22 13:56
Last updated on HF
2025-04-30 02:05
Source huggingface.co/DevQuasar/huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3-GGUF ↗ Base model huihui-ai/Qwen2.5-0.5B-Instruct-abliterated-v3 →

Files by quantization

F16 1 file 948 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.f16.gguf 948 MB 154f9b92 download
Q8_0 1 file 506 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q8_0.gguf 506 MB d316830f download
Q6_K 1 file 482 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q6_K.gguf 482 MB d843571a download
Q5_K 2 files 794 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q5_K_M.gguf 401 MB 724a2ffb download
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q5_K_S.gguf 394 MB a7dffabe download
Q4_K 2 files 747 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q4_K_M.gguf 379 MB aa2a1cc9 download
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q4_K_S.gguf 368 MB 1cae195b download
Q3_K 3 files 1014 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q3_K_L.gguf 352 MB c5a88b2a download
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q3_K_M.gguf 339 MB 6aee4f07 download
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q3_K_S.gguf 323 MB f35deb20 download
Q2_K 1 file 323 MB
huihui-ai.Qwen2.5-0.5B-Instruct-abliterated-v3.Q2_K.gguf 323 MB 4a512109 download
Auxiliary files 2 files 3.37 KB
.gitattributes 2.50 KB 95135b51 download
README.md 895 B abab6297 download

README current version from Hugging Face

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-04-30Upload README.md with huggingface_hubcfaefeb895 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration