← back to catalog · registered 2026-08-22 13:56

huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

huihui-ai Qwen 9B GGUF 1.0M ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/huihui-ai%2FHuihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF"
Response includes
  • classification m8
  • files 8
  • hub_downloads_all_time 195,706
  • author_summary 185 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of layer-wise ablation inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=huihui-ai + is_gguf=1
  • M3 (huihui abliteration) wrapped in M8 (GGUF quantization)
Refusal direction extracted via
Extraction technique

huihui-ai layer-band extraction

Confidence
HIGH
Why we say so
producer=huihui-ai (documented layer-band methodology in model cards)
Downloads · lifetime
196K
34K last 30d - stable
Likes
209
Model age
3mo ago
created 2026-06-25
Downloads over time
Now212.5K→from5.5K↑3,743%
077.9K155.8K233.8K5.5K on Jun 24212.5K on Oct 11JunJulAugSepOct
Jun 24 → Oct 11 · 58 snapshots · spans 109 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 34K downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
apache-2.0
Languages
en
Quantizations
BF16 Q4_K Q5_K Q6_K Q8_0
Tags
transformers gguf qwen3.5 reasoning uncensored long-context 1M-context function-calling tool-use sft full-fine-tune cybersecurity

Related

Total size
44.9 GB
Files
8
Quantizations
6
Registered
2026-08-22 13:56
Last updated on HF
2026-06-25 18:11

Files by quantization

BF16 2 files 18.0 GB
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-bf16.gguf 17.1 GB 330af9ec download
mmproj-model-bf16.gguf 879 MB 58a875ef download
Q8_0 1 file 9.11 GB
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-Q8_0.gguf 9.11 GB 7df69762 download
Q6_K 1 file 7.04 GB
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-Q6_K.gguf 7.04 GB 3befaa91 download
Q5_K 1 file 6.19 GB
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-Q5_K.gguf 6.19 GB 199f0d2a download
Q4_K 1 file 5.38 GB
Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-Q4_K.gguf 5.38 GB 11d81ce5 download
Auxiliary files 2 files 5.07 KB
README.md 3.07 KB 9fefd810 download
.gitattributes 2.00 KB ac645827 download

README current version from Hugging Face


license: apache-2.0
language:

  • en
    library_name: transformers
    pipeline_tag: text-generation
    base_model:
  • empero-ai/Qwythos-9B-Claude-Mythos-5-1M
    tags:
  • qwen3.5
  • reasoning
  • uncensored
  • long-context
  • 1M-context
  • function-calling
  • tool-use
  • sft
  • full-fine-tune
  • cybersecurity
  • biomedical
  • agentic
  • abliterated
  • uncensored
  • GGUF
  • MTP

huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

This is an uncensored version of empero-ai/Qwythos-9B-Claude-Mythos-5-1M created with abliteration.

Note In non-thinking mode, this model strictly adheres to the first prompt's instructions, delivering only the requested output—whether a translation or a specific format—without any introductory or concluding fluff.

GGUF

Please use the latest version of ggml-org/llama.cpp

apt-get update
apt-get install pciutils build-essential cmake curl libcurl4-openssl-dev -y
git clone https://github.com/ggml-org/llama.cpp
cmake llama.cpp -B llama.cpp/build \
    -DBUILD_SHARED_LIBS=OFF -DGGML_CUDA=ON
cmake --build llama.cpp/build --config Release -j --clean-first --target llama-cli llama-mtmd-cli llama-server llama-gguf-split
cp llama.cpp/build/bin/llama-* llama.cpp
./llama.cpp/llama-cli \
    -m huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-Q4_K.gguf \
    -ngl 99 -c 262144 -fa on -np 1 \
    --spec-type draft-mtp --spec-draft-n-max 2

Usage Warnings

  • Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

  • Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

  • Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

  • Research and Experimental Use: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

  • Monitoring and Review Recommendations: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

  • No Default Safety Guarantees: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.

Donation

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
  • Support our work on Ko-fi!

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-06-25Update README.mde7ed8bf3.1 KB
    Loading...
  2. 2026-06-25Create README.md7a8a16a2.8 KB
    Loading...

Discussions 1 thread

  1. 2026-07-29seems unnecessaryopen1 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration