license: other
license_name: qwen-community-1.0
license_link: https://huggingface.co/orcarouter/Qwen3.8-Flash-Next-Uncensored/blob/8336e613ea508b13c2159bd0f68965d97a606b95/LICENSE
base_model: orcarouter/Qwen3.8-Flash-Next-Uncensored
base_model_relation: quantized
pipeline_tag: image-text-to-text
tags:

• gguf
• mixed-quant
• qwen4exp
• qwen3.8-flash-next
• uncensored
• abliterated
• dgx-spark
• ds4
• ssd-offload

Qwen3.8-Flash-Next-Uncensored Mixed-Quant SSD-PLE GGUF

This is a direct BF16 conversion of
orcarouter/Qwen3.8-Flash-Next-Uncensored
using the exact tensor-level MQ-Q5-SSD-PLE-BF16 recipe published for
Qwen3.8-Flash-Next-Mixed-Quant-SSD-PLE-GGUF.
It is not requantized from an existing GGUF.

The 51.2B-parameter predictive latent embedding (PLE) table is stored as a
four-file BF16 SSD sidecar. A fresh extraction from the uncensored source
checkpoint was performed; all four resulting files are byte-identical to
the public reference PLE files. They are nevertheless included directly in
this repository so the Q5 artifact is self-contained.

A dedicated ds4 external SSD-PLE loader is required. Compatibility with
generic llama.cpp, vLLM, SGLang, or other GGUF runtimes is not implied.

Support my work

I work on making large language models practical on hardware they were never
really designed to fit on — through mixed quantization, inference
optimization, custom kernels, and serving experiments.

While much of the development happens on local hardware, calibration,
profiling, and large-scale validation often require expensive on-demand GPUs.

Contributions help pay for that compute, storage, and testing infrastructure,
so I can keep experimenting and publishing the results openly.

Source and recipe pins

The destination checkpoint has the same audited tensor topology as the recipe
source: 1,658 source tensors and 179,999,981,459 parameters. The released Q5
main map matches the public reference row for row: zero missing, extra, or
changed tensor recipes.

Download and verify

repo=Baekpica/Qwen3.8-Flash-Next-Uncensored-Mixed-Quant-SSD-PLE-GGUF
root=./Qwen3.8-Flash-Next-Uncensored-Mixed-Quant-SSD-PLE-GGUF
variant=MQ-Q5-SSD-PLE-BF16

hf download "$repo" \
  --include "$variant/*" \
  --local-dir "$root"

(cd "$root/$variant" && sha256sum -c SHA256SUMS)

The main GGUF is split into three files. The PLE sidecar is stored under
MQ-Q5-SSD-PLE-BF16/ple/ as four page-aligned files, so no local symlink or
second variant download is required.

Quantization recipe

Only the K-quant tiers from the original Q6 SSD-PLE map are lowered:
Q5_K → Q4_K for 88 tensors and Q6_K → Q5_K for 56 tensors. The 48
width-128 expert-down tails remain Q5_0, preserving the existing optimized
tail kernel and dispatch. There is no pruning, expert dropping, expert
merging, or layer dropping.

Audited storage metrics

GGUF metadata/alignment, bounded PLE cache, KV state, and runtime workspace
are separate from the tensor-payload figures above.

Artifact layout

MQ-Q5-SSD-PLE-BF16/
├── Qwen3.8-Flash-Next-Uncensored-MQ-Q5-SSD-PLE-BF16-*.gguf
├── SHA256SUMS
├── SHA256SUMS.main
├── quant-recipe.yaml
├── artifact-manifest.json
├── main-artifact-manifest.json
├── verify-main-gguf.json
└── ple/
    ├── ple-bf16-00001-of-00004.bin
    ├── ple-bf16-00002-of-00004.bin
    ├── ple-bf16-00003-of-00004.bin
    ├── ple-bf16-00004-of-00004.bin
    ├── ple-manifest.json
    └── SHA256SUMS

Artifact verification

The included manifests and reports cover:

• source checkpoint revision and full local-file integrity;
• exact source tensor names, shapes, dtypes, shard membership, and parameter count;
• row-for-row equivalence with the public Q5 tensor recipe;
• exact equivalence of all 128 PLE logical parts, four physical-file layouts,
  offsets, control values, and alignment rules;
• BF16 PLE extraction with per-part hashes and complete-file rereads;
• independent SHA-256 reads of all seven weight files;
• GGUF v3 metadata, split numbering, tensor names, shapes, types, offsets,
  extents, byte counts, and payload bounds;
• remote Hub LFS byte counts and SHA-256 values after upload.

These are artifact-integrity checks. Runtime throughput, long-context quality,
and DGX Spark acceptance were not re-benchmarked for this fine-tuned weight
set and are not claimed here.

SSD runtime contract

The 95.37 GiB PLE sidecar must not become resident in the accelerator's
unified-memory pool. The ds4 path expects exact CPU-side Qwen n-gram row
derivation, asynchronous SSD prefetch, a bounded pinned page cache, and mapped
UVA gather. Registering or unbounded-mapping the entire sidecar defeats the
artifact's residency objective.

Detailed ds4 performance results, long-context tests, multimodal tests, and
runtime engineering notes are intentionally not repeated here. See the
public reference model card
for those results and the current ds4 implementation context.

Reproduction

The converter, Q5/PLE plan builders, source-map port and audit tools,
quantizer source, pinned manifests, and verification reports are included in
the reproduction directory. Exact commands are documented
in reproduction/README-Uncensored-Q5.md.

License and behavior

The included LICENSE is the Qwen Community License 1.0 copied
from the pinned source checkpoint. This quantization does not add safety
training or change the behavioral intent of the source fine-tune; review the
source model card
before deployment.