license: other
license_name: qwen-community-1.0
license_link: https://huggingface.co/Qwen/Qwen3.8-Flash-Next/blob/main/LICENSE
base_model: unsloth/Qwen3.8-Flash-Next-GGUF
base_model_relation: finetune
library_name: gguf
model_name: Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated
pipeline_tag: text-generation
tags:
- qwen3.8
- gguf
- abliterated
- uncensored
- tensor-transplant
- moe
Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated
An experimental abliteration of Unsloth's Qwen3.8-Flash-Next UD-IQ4_XS GGUF, using selected weights from OrcaRouter's Qwen3.8-Flash-Next-Uncensored-GGUF.
Disclosure: This model was created with AI assistance under my direction. The AI performed the tensor transplant by following SC117's published instructions. I tested its refusal behavior myself and did not encounter refusals in the use cases I tried. I did not run a formal refusal benchmark.
At a glance
| Original Unsloth UD-IQ4_XS | This release | |
|---|---|---|
| GPQA Diamond, two runs | 347/396, 87.63% | 347/396, 87.63% |
| MMLU-Pro business subset, completed run | 657/722, 91.00% and 649/722, 89.89% | 650/722, 90.03% |
| Text diagnostic perplexity, 4,995 positions | 3.8956 | 4.0636, 4.31% higher |
| Full-vocabulary KL, 20 positions, relative to original Unsloth | Reference | Mean 0.1119 nats, median 0.0062, maximum 0.6481 |
| Completion tokens in GPQA runs | Reference | About 7.3% more across two runs |
The automatic benchmarks show no consistent GPQA score advantage or loss. The completed MMLU comparison is close to the original Unsloth run range, but it covers business questions only. The perplexity increase is a real regression on the small text diagnostic. None of these measurements proves that all capabilities are preserved.
Observed response length: under the tested xhigh reasoning setup, this release used more completion tokens and produced longer saved reasoning traces than the original Unsloth model. The API did not separate reasoning tokens from final answer tokens. This may increase latency and inference cost. It is an observed tendency in these runs, not a guarantee for every prompt.
Sampling limitation: no fixed random seed was set or recorded. Runs were not seed matched, so differences in scores and token use may partly reflect sampling variation. Do not attribute the longer reasoning solely to abliteration.
Model and method
The base is Unsloth's four-shard Qwen3.8-Flash-Next-UD-IQ4_XS GGUF. The donor is OrcaRouter's IQ4_XS Qwen3.8-Flash-Next-Uncensored-GGUF, revision 98eb3357afd966c25cadd082c7f830eafde7aa52. The tensor transplant follows the method documented by SC117, adapted to Unsloth's quantization.
| Residual-stream writer tensor family | Count |
|---|---|
blk.*.ssm_out.weight |
36 |
blk.*.attn_output.weight |
12 |
blk.*.ffn_down_shexp.weight |
48 |
blk.*.ffn_down_exps.weight |
48 |
| Total | 144 |
Only the selected donor tensor ranges were downloaded, approximately 23.09 GB. The full OrcaRouter model was not downloaded. Thirteen tensors with matching types were copied verbatim. The other 131 were re-encoded into the original Unsloth tensor types using Unsloth's original block scales. This preserves GGUF tensor layout and scale bytes, but adds quantization approximation error. It is not a lossless transplant and does not retain SC117's learned GSQ scales.
A BLAKE2b audit covered all 1,224 tensors: 144 changed as intended and 1,080 remained byte identical to the local Unsloth source. Headers, offsets, tensor types, shard sizes, and the shared ngram table were preserved. This verifies file integrity, not behavioral quality.
The work was made for personal use on a desktop PC with limited time and compute. It is not claimed to be the best possible abliteration or an improvement over SC117's GSQ-RCO release. I previously used SC117's version, but did not complete a direct benchmark comparison against it. Only this UD-IQ4_XS variant is planned.
Evaluation
Models were run sequentially on one NVIDIA GeForce RTX 5080 with 16 GB VRAM, 128 GB RAM, Windows 11, and Strata engine build 0.1.59 (712fec6b4297, CUDA 13.0).
Sampling followed Unsloth's published thinking settings: temperature 1.0, top-p 0.95, top-k 20, min-p 0, presence penalty 0, repetition penalty 1, thinking enabled, preserve thinking enabled, and xhigh reasoning effort. The local run used a 16,384 token output cap, int8 KV cache, 30,720 resident KV tokens, configured maximum context 262,144, MTP speculation value 5, and spec-min-p 0.5. This was not a reproduction of Unsloth's full benchmark harness.
GPQA Diamond
All 198 questions were run twice per model using automatic answer matching. Combined totals were identical. Invalid or unparseable outputs count as incorrect.
| Model | Run 1 | Run 2 | Combined |
|---|---|---|---|
| Original Unsloth UD-IQ4_XS | 174/198, 87.88% | 173/198, 87.37% | 347/396, 87.63% |
| This release | 175/198, 88.38% | 172/198, 86.87% | 347/396, 87.63% |
The same 198 questions were reused across runs, so 396 is the number of attempts, not distinct questions. There were four invalid outputs from Unsloth and two from this release across the two runs.
MMLU-Pro subset
The full test split has 12,032 questions. Only the first 722 after sorting by question ID were evaluated, approximately 6.0% of the split. An audit found all 722 are in the business category, so this is not a broad MMLU-Pro result.
| Model | Run 1 | Run 2 |
|---|---|---|
| Original Unsloth UD-IQ4_XS | 657/722, 91.00% | 649/722, 89.89% |
| This release | 650/722, 90.03% | Incomplete: 141/156, not a full-set score |
The second run for this release was stopped at 156 of 722 questions because local compute and time were limited. It is not pooled with the completed run. On the completed run, this release was 0.97 points below original run 1 and 0.14 points above original run 2. A paired question bootstrap estimated a difference of minus 0.42 points versus the mean of both original runs, with a 95% percentile interval from minus 1.94 to plus 1.11 points. This interval is conditional on the selected business questions and observed generations. It does not correct for category selection or the incomplete candidate repeat.
Text and distribution diagnostics
Perplexity was measured on the same fixed text corpus at 4,995 teacher-forced positions. It increased from 3.8956 for Unsloth to 4.0636 for this release, a 4.31% increase. This indicates worse prediction of this text, not a 4.31% loss of general capability.
Full-vocabulary KL used 20 fixed prefixes and all 248,320 vocabulary entries, in the direction KL(original || this release). Mean KL was 0.1119 nats, median 0.0062, maximum 0.6481. Top-1 matched at 18/20 positions. This is a small diagnostic sample, not task accuracy or a refusal measure.
A separate 4,995-position diagnostic used a truncated top-64 KL approximation: mean 0.122543 and 99th percentile 1.658857. This is not full-vocabulary KL and should not be compared with Unsloth's quantization KLD figures.
Limitations
No controlled refusal or benign over-refusal benchmark was run. My personal checks found the model sufficiently uncensored for my use, but some refusals may remain and behavior may vary by prompt, language, or setting.
No direct comparison with SC117's GSQ-RCO-abliterated model was completed. The published results for OrcaRouter's donor were not independently reproduced on this converted Unsloth build.
The contribution of donor abliteration cannot be separated from differences between donor quantization and Unsloth quantization, including re-encoding 131 tensors. No full MMLU-Pro run, LiveCodeBench, Terminal Bench, other agent benchmark, tool use, vision, or long-context retrieval evaluation was completed. Other inference engines were not tested.
Attribution
| Contribution | Source |
|---|---|
| Original model | Qwen team, Qwen3.8-Flash-Next |
| Base GGUF quantization | Unsloth, Qwen3.8-Flash-Next-GGUF |
| Abliterated donor | OrcaRouter, Qwen3.8-Flash-Next-Uncensored-GGUF |
| Transplant method and guide | SC117, Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF |
| Inference engine | Strata |
SC117's release is based on ISTA-DASLab's GSQ-RCO quantization. This release is based on Unsloth's UD-IQ4_XS and is not a reproduction of SC117's model. OrcaRouter's donor metadata declares Apache 2.0; the underlying Qwen weights are subject to the Qwen Community License 1.0. These upstream terms and notices remain applicable.
Files and use
The release contains four GGUF shards totaling approximately 93.67 GB. Download all four files and keep them together. Only UD-IQ4_XS is provided.
The file names explicitly include Abliterated to distinguish them from the original Unsloth files:
Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated-00001-of-00004.gguf
Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated-00002-of-00004.gguf
Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated-00003-of-00004.gguf
Qwen3.8-Flash-Next-UD-IQ4_XS-Abliterated-00004-of-00004.gguf
For Strata, use a native pack built from this model, not the original Unsloth pack. The MTP draft head used in local evaluation was reused unchanged and is not abliterated.
This is an experimental model. Reduced refusal behavior does not make its output reliable or safe. Review outputs before using them in consequential settings.