← back to catalog · registered 2026-09-22 02:56

satellitedown/Huihui-Qwen3.8-27B-abliterated-NVFP4-NInfer-v3

satellitedown 27B multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/satellitedown%2FHuihui-Qwen3.8-27B-abliterated-NVFP4-NInfer-v3"
Response includes
  • classification m1
  • files 7
  • hub_downloads_all_time 184
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
184
Likes
1
Model age
6w ago
created 2026-09-22
Downloads over time
Now3.1K→from0↑0%
01.1K2.3K3.4K0 on Sep 223.1K on Nov 6SepOctNov
Sep 22 → Nov 6 · 46 snapshots · spans 45 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
ninfer nvfp4 qwen3.8 abliterated blackwell rtx-5090 mtp image-text-to-text base_model:huihui-ai/Huihui-Qwen3.8-27B-abliterated base_model:quantized:huihui-ai/Huihui-Qwen3.8-27B-abliterated license:apache-2.0 region:us

Related

Total size
0 B
Files
7
Quantizations
1
Registered
2026-09-22 02:56
Last updated on HF
2026-09-22 02:42

Files by quantization

Auxiliary files 7 files 20.0 GB
qwen3_8_27b_huihui_abliterated_nvfp4.ninfer 20.0 GB 3876a052 download
LICENSE 11.3 KB f938136e download
NOTICE 3.42 KB f49f2098 download
provenance.json 1.80 KB 50eaec83 download
.gitattributes 1.56 KB c01072fa download
README.md 1.23 KB a26afd37 download
SHA256SUMS 705 B 25fafcbb download

README current version from Hugging Face


library_name: ninfer
pipeline_tag: image-text-to-text
inference: false
license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.8-27B-abliterated
base_model_relation: quantized
tags:

  • ninfer
  • nvfp4
  • qwen3.8
  • abliterated
  • blackwell
  • rtx-5090
  • mtp

Huihui Qwen3.8-27B Abliterated NVFP4

Ready-to-use NInfer v3 model for Cinference on an RTX 5090 (32 GB).

One 21.5 GB model file, with text, vision, and MTP weights included. No conversion needed.

Run

Use the one-menu Cinference installer:

git clone https://github.com/satellitedown/fast-long-context-cinference.git
cd fast-long-context-cinference
bash setup.sh

Choose 1 to install, then 3 to start. Requires Linux and NVIDIA drivers compatible with CUDA 13.4.

Credits

Repackaged from Barding-Defense's Huihui NVFP4 artifact. Weight bytes are unchanged; the container is v3 and uses Cinference's maintained Qwen3.8 chat template.

Qwen, Huihui AI, Barding-Defense, NInfer, and Cinference. License · Attribution · Provenance · Checksums.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-09-22feat: publish ready-to-use Huihui NVFP4 v312fe3b11.2 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration