← back to catalog · registered 2026-11-17 01:03

rkcth/Huihui-Gemma-4-31B-it-Abliterated-Radiance-W4A8

rkcth Gemma 31B second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/rkcth%2FHuihui-Gemma-4-31B-it-Abliterated-Radiance-W4A8"
Response includes
  • classification m1
  • files 6
  • author_summary 3 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
0
Likes
1
Model age
5d ago
created 2026-11-17
Downloads over time
Now 0 → from 0 ↑ 0%
0011 0 on Nov 17 0 on Nov 22 Nov
Nov 17 → Nov 22 · 6 snapshots · spans 5 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
radiance amd rad2 text-generation base_model:huihui-ai/Huihui-gemma-4-31B-it-abliterated base_model:quantized:huihui-ai/Huihui-gemma-4-31B-it-abliterated license:apache-2.0 region:us

Related

Total size
0 B
Files
6
Quantizations
1
Registered
2026-11-17 01:03
Last updated on HF
2026-11-17 01:00

Files by quantization

Auxiliary files 6 files 20.4 GB
huihui-gemma4-31b-it-w4a8.rad 20.4 GB 6eae9fb1 download
LICENSE 11.1 KB d6456956 download
.gitattributes 1.55 KB 052ace2f download
README.md 1.22 KB 6daa16d9 download
NOTICE 409 B ee4a1e80 download
SHA256SUMS 96.0 B 9f6f1440 download

README current version from Hugging Face


license: apache-2.0
pipeline_tag: text-generation
base_model: huihui-ai/Huihui-gemma-4-31B-it-abliterated
base_model_relation: quantized
tags:

  • radiance
  • amd
  • rad2

Huihui Gemma 4 31B it Abliterated Radiance W4A8

Gemma 4 31B dense with W4A8 attention and feed-forward projections. The checkpoint is 20.40 GiB.

Verified for chat on two Radeon AI PRO R9700s as a secondary model alongside Qwen Flash Next. Use the chat endpoint with model: gemma4-31b-abliterated.

Build the executable and plugins together from the Radiance fork.
Download huihui-gemma4-31b-it-w4a8.rad and add this entry to the Radiance YAML configuration.
Adjust the model path to match your installation.

models:
  gemma4-31b-abliterated:
    model: /models/huihui-gemma4-31b-it-w4a8.rad
    tp: 2
    max-model-len: 8192
    max-num-seqs: 2
    max-num-batched-tokens: 512
    num-speculative-tokens: 0

Verify the downloaded checkpoint against SHA256SUMS with
sha256sum -c SHA256SUMS. License and attribution are in LICENSE and NOTICE.
The conversion uses the pinned source checkpoint.

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-17 Upload 5 files 1f94395 1.2 KB
    Loading...
  2. 2026-11-17 initial commit 22dfe7c 28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration