← back to catalog · registered 2026-09-23 22:57

Dyluhn/Qwen3.8-Flash-Next-Uncensored-R9V-IQ4_XS

Dyluhn GGUF multimodal second-order
curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Dyluhn%2FQwen3.8-Flash-Next-Uncensored-R9V-IQ4_XS"
Response includes
  • classification m8
  • files 7
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-09-23

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Tags
safetensors gguf rocm vision speculative-decoding qwen3.8 abliterated uncensored ced base_model:orcarouter/Qwen3.8-Flash-Next-Uncensored base_model:quantized:orcarouter/Qwen3.8-Flash-Next-Uncensored license:other

Related

Total size
0 B
Files
7
Quantizations
1
Registered
2026-09-23 22:57
Last updated on HF
2026-09-23 22:43

Files by quantization

Auxiliary files 7 files 32.6 KB
README.md 8.07 KB 9b128da5 download
sources.lock.json 6.44 KB 68eac2d5 download
package.json 5.71 KB 21cbc5bb download
THIRD_PARTY_NOTICES.md 4.20 KB 22143377 download
LICENSE 3.14 KB 79ab8f28 download
publication.json 3.14 KB e5b5a637 download
.gitattributes 1.93 KB a3b109e0 download

README current version from Hugging Face


license: other
license_name: qwen-community-1.0
license_link: LICENSE
base_model: orcarouter/Qwen3.8-Flash-Next-Uncensored
base_model_relation: quantized
tags:

  • gguf
  • rocm
  • vision
  • speculative-decoding
  • qwen3.8
  • abliterated
  • uncensored
  • ced

Qwen3.8 Flash Next Uncensored R9V IQ4_XS

Ready-to-arrange model bundle for the
R9V dual-RDNA4 inference profile. It uses the
same layout as
Qwen3.8-Flash-Next-R9V-IQ4_XS.
The difference is that the target and vision projector come from orcarouter's
abliterated (uncensored) build of Qwen3.8 Flash Next, and that the package also
carries the CED projector for faster long-prompt prefill, which R9V turns on by
default (see Long-prompt prefill (CED)).

Uncensored model: read first

orcarouter removed the model's refusal behaviour by abliteration: it projected
a single "refusal direction" out of the weights. In orcarouter's words, the
model has had its safety alignment substantially removed and will comply with
harmful, unethical or illegal requests that the original Qwen3.8 Flash Next
would refuse. orcarouter releases it strictly for research: interpretability,
refusal-mechanism study, red-teaming and robustness evaluation. You are
responsible for how you use it and for everything it generates. Add your own
safety and moderation layers before putting it in front of anyone. See the
orcarouter model card
for their method and evaluations.

Contents and provenance

  • target/: UD-IQ4_XS target GGUF shards, quantized for this package from
    orcarouter's Q8_0 GGUF of the abliterated weights. The per-tensor types follow
    Unsloth's UD-IQ4_XS recipe exactly (1,224 of 1,224 tensors). Unsloth did
    not produce these files. They were quantized from Q8_0 rather than BF16, and
    no importance matrix is recorded for them. Their quality has not been
    measured against Unsloth's own UD-IQ4_XS.
  • vision/: orcarouter's F16 vision projector, unchanged. orcarouter states
    that abliteration did not touch the vision tower.
  • mtp/: R9V-assembled minimal MTP checkpoint, byte-identical to the reference
    package. Dense/nonexpert tensors come from the official BF16 checkpoint and
    routed experts from the official block-FP8 checkpoint. R9V did not train
    these weights. This is Qwen's original MTP head, not an abliterated one. It
    only drafts tokens, and the target checks every one, so output comes from the
    uncensored target.
  • ced/: the split-16 CED prefill projector, fitted by R9V to this exact
    quant. It is byte-identical to ced-projector-split16.safetensors in
    Qwen3.8-Flash-Next-Uncensored-CED-Projector
    (revision a588077a52b7c0061f7f38d0b05730a523ecd88d).
  • metadata/: official Qwen tokenizer, processor, and model configuration.
  • manifests/: the reference dual-R9700 hot-expert placement, bound to this
    package's target files. Abliteration leaves the MoE routers untouched.
  • sources.lock.json: exact upstream revisions, sizes, and hashes.

Qwen remains the model author and upstream rights holder. orcarouter is
credited for the abliteration, the Q8_0 source and the vision projector.
Unsloth is credited for the UD-IQ4_XS recipe.

Install with R9V

Use R9V v0.4.0 or later with the profile qwen38-mtp4-uncensored. Setup does
everything: it downloads and SHA-256 verifies every file in this package,
extracts the PLE table, loads the pinned runtime image and checks the host.
The first start qualifies the placement on your machine.

./r9v setup qwen38-mtp4-uncensored --model-dir "$MODEL_DIR" -- --accept-model-license
./r9v start qwen38-mtp4-uncensored -- --timeout 2400

The first start compiles the model, so give it a long timeout. See the
R9V installation guide.

The 26.82 GiB per_layer_token_embd.weight (PLE) payload is already present
inside target shard 2 and is intentionally not uploaded again. Setup extracts
it with R9V's metadata-driven tool. The extracted file's SHA-256 is
34fa36f83de4216fe2aa78b5602aea1ba8007f959710c94bc4fbaff3e75fb9f0.

Reference configuration

  • Two Radeon AI PRO R9700 32 GiB GPUs, TP2.
  • 128 GiB DDR5.
  • MTP depth 4.
  • 131,072-token capacity, one request at a time.
  • F16 vision input, one image/request.
  • SSD PLE and tiered expert placement: experts outside the VRAM-resident hot
    set are served from a host-RAM cache.

Measured performance

Measured on the reference configuration above with the consolidated 1.3.0
runtime that R9V v0.4.0 ships.

Decode, greedy, warm runs:

Prompt ms per decode step Tokens per step (MTP 4)
Short prose 34.6 2.54
Short code 37.4 3.96
~8K context 38.8 3.45

Exact prefill (CED not used) is about 1,780 tok/s on ~4K-token prompts and
1,870 tok/s on ~12K-token prompts. With CED on, as R9V ships it, ~12K-token
prompts prefill at about 3,020 tok/s; prompts under 8,192 tokens are unchanged.
These prompts are synthetic word lists. Real text measured roughly 15–20%
slower on earlier R9V builds.

BetterBench 0.6.0, single stream, 20
runs per category, temperature 0.7: median decode ranged from 62 tok/s
(reasoning) to 94 tok/s (JSON).

Long-prompt prefill (CED): on by default

CED approximates the late layers for the early part of a long prompt. Layers
0–15 run exactly on every prompt token. The projector in ced/ predicts what
layers 16–47 would see, and those layers only fill their caches from the
prediction. The last ~2K prompt tokens and every decode step run the full model
exactly.

R9V loads the projector at start and uses CED on prompts of 8,192 tokens or
more, with a 2,048-token exact tail. The tradeoff, measured on the reference
configuration:

  • Faster: prefill of prompts of 12K tokens or more is about 1.70×
    faster (median). ~12K-token prompts went from 1,868 to 3,018 tok/s.
  • Quality cost: about ×1.051 perplexity on prompts that depend on their
    long context (ΔNLL +0.050 ± 0.037 nats/token on the last 512 prompt tokens).
  • MTP cost: on the first answer after a CED prefill, MTP accepts about
    10% fewer tokens per step, so that answer decodes about 10% slower. A
    follow-up turn is back to normal.
  • VRAM: the projector takes 1.76 GiB per GPU (bf16). Having it loaded costs
    no decode speed.
  • Not approximated: prompts with images, prompts shorter than 8,192 tokens,
    and requests for prompt logprobs run exactly.

To turn CED off for the whole server, run ./r9v setup or ./r9v start with
--ced off. The projector is then not loaded. To keep one request exact, send
"vllm_xargs": {"r9v_ced": false} (OpenAI Python client:
extra_body={"vllm_xargs": {"r9v_ced": False}}).

The CED projector was fitted on English-heavy code, docs and prose of up to
~20K tokens. See the
CED projector repository
for the method, the full grade and its limitations.

Status

The immutable 24-file model package is public and remotely hash-verified
at revision b06687cb2f83ea38039cadd249341a7bd5b76fa3. The R9V runtime for this profile remains
experimental until the documented package
installation passes from a clean host.

License

These model artifacts are distributed under Qwen Community License 1.0; see
LICENSE. orcarouter's model card labels the abliterated weights Apache-2.0.
However, orcarouter's own repository LICENSE file is the Qwen Community License,
and the weights are a derivative of Qwen3.8 Flash Next, so this package follows
the upstream Qwen license. The R9V Apache-2.0 code license does not apply to
model weights. Users are responsible for reviewing the Qwen license, including
its separate terms for certain commercial MaaS/AI-work-assistant uses and scale
thresholds. Artifact attribution and exact upstream revisions are recorded in
THIRD_PARTY_NOTICES.md.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in app" button that hands off directly to a local runtime of your choice - Abliteration, LM Studio, or Ollama. No API keys, no subscription, no prompt leakage.