license: other
license_name: qwen-community-1.0
license_link: https://huggingface.co/Qwen/Qwen3.8-Flash-Next/blob/main/LICENSE
base_model:

• orcarouter/Qwen3.8-Flash-Next-Uncensored
  base_model_relation: quantized
  pipeline_tag: image-text-to-text
  library_name: gguf
  quantized_by: Navin-Models
  language:
• en
• zh
  tags:
• qwen
• qwen3.8
• qwen4-exp
• gguf
• llama.cpp
• uncensored
• abliterated
• mixture-of-experts
• vision-language
• function-calling
• reasoning
• mtp
• imatrix
• research
  extra_gated_prompt: >-
  This is an abliterated research model with substantially reduced safety alignment.
  It may produce harmful, illegal, offensive, biased, or otherwise unsafe content.
  Access is provided for legitimate research and controlled evaluation. You are responsible
  for lawful use, downstream safeguards, and compliance with the Qwen Community License 1.0.
  extra_gated_fields:
  I have read and accept the included Qwen Community License: checkbox
  I understand that safety alignment has been substantially removed: checkbox
  I will use this release lawfully and take responsibility for appropriate safeguards: checkbox

Qwen3.8-Flash-Next-Uncensored AD-4.27 GGUF

[!CAUTION]
Research artifact with substantially reduced safety alignment. This model is derived from an abliterated checkpoint and may comply with harmful, unethical, illegal, offensive, biased, or otherwise unsafe requests that the aligned model would refuse. It has no dependable built-in guardrails. Do not expose it to end users or production traffic without independently designed safety, moderation, access-control, logging, and abuse-prevention measures. You are responsible for how you use it and for compliance with applicable law.

A reproducible, tensor-specific mixed GGUF quantization of orcarouter/Qwen3.8-Flash-Next-Uncensored, pinned at revision 8336e613ea508b13c2159bd0f68965d97a606b95.

Why this quantization exists

The practical target of this build is to run Qwen3.8 Flash-Next—including its matching MTP draft path and vision projector—on a machine with 64 GB of aggregate VRAM. The complete release is about 91.47 GiB, so the entire package is not meant to reside in VRAM. Instead, the 38.4 GB PLE n-gram table is isolated in shard 2 and left SSD-pageable through mmap; the remaining GGUF payload is 59,808,378,272 bytes (about 55.70 GiB). This makes the GPU-resident model portion practical on a dual-32-GB setup while retaining the model's PLE, native long-context configuration, vision path, and MTP acceleration.

This build applies AtomicChat's published AD-4.27bpw-Q4_K_M-M64 tensor recipe and BF16 importance matrix to the target model only. The matching uncensored MTP/NextN weights were exported separately through llama.cpp's official --mtp path and then attached without applying the target-only importance matrix to MTP tensors. The F16 vision projector is included.

This is an independent community build. It is not produced, endorsed, or warranted by Qwen, Alibaba, OrcaRouter, AtomicChat, or llama.cpp.

Contents

Total GGUF payload: 98,208,562,784 bytes (approximately 91.47 GiB).

Tensor recipe

The 4.27 bpw name describes the measured mixed target recipe, not a uniform tensor type. Some tools may display a representative GGUF ftype such as IQ2_S; that does not describe the full tensor mix.

Requirements

Use a llama.cpp build with Qwen3.8 Flash-Next (qwen4exp) and MTP support. This release was constructed with llama.cpp commit:

d1a92352cbd417fd840b4e765c0b82f5fe3d1d89

Keep mmap enabled so the isolated PLE shard can remain SSD-pageable. Use --fit off to preserve the intended placement.

Example: llama-server

llama-server \
  --model Qwen3.8-Flash-Next-Uncensored-AD-4.27-main-00001-of-00034.gguf \
  --mmproj mmproj-Qwen3.8-Flash-Next-Uncensored-F16.gguf \
  --no-mmproj-offload --image-min-tokens 1024 \
  --spec-type draft-mtp --spec-draft-n-max 3 --spec-draft-p-min 0.75 \
  --spec-draft-type-k f16 --spec-draft-type-v f16 \
  --ctx-size 262144 --cache-type-k q8_0 --cache-type-v q8_0 \
  --gpu-layers 999 --flash-attn on --fit off --jinja

Hardware-specific flags such as --tensor-split, device placement, batch sizes, and tensor overrides must be adapted to the host. For a dual-32-GB setup, begin with one slot, --tensor-split 0.50,0.50, target Q8 KV, and draft F16 KV.

Provenance and attribution

1. Qwen / Alibaba: Qwen/Qwen3.8-Flash-Next, the upstream model and architecture.
2. OrcaRouter: orcarouter/Qwen3.8-Flash-Next-Uncensored, revision 8336e613ea508b13c2159bd0f68965d97a606b95, the BF16 abliterated source checkpoint, including the matching vision and MTP weights.
3. AtomicChat: AtomicChat/Qwen3.8-Flash-Next-GGUF, the published AD-4.27 tensor recipe and BF16 importance matrix. The matrix used here had SHA-256 5591ce3dc3bf0b73d3c074bc588c90b6c4f7b3c273de6b10e50d111b75f05487.
4. llama.cpp: conversion, quantization, sharding, GGUF loading, multimodal inference, and MTP runtime.
5. Navin Model Repository: independent conversion of the pinned OrcaRouter checkpoint, target-only recipe application, separate MTP export and attachment, sharding, and checksums.

See REPRODUCIBILITY.md for the exact construction path and ATTRIBUTION.md for notices.

License and access conditions

The repository metadata of the OrcaRouter source says apache-2.0, but the actual LICENSE file distributed in the pinned source checkpoint—and the upstream Qwen model's current license—is Qwen Community License 1.0. To avoid granting rights that the publisher may not possess, this repository applies and includes the actual Qwen Community License 1.0. The more permissive Apache label is not relied upon here.

The Qwen Community License 1.0 permits use, copying, modification, publication, distribution, sublicensing, sale, deployment, hosting, fine-tuning, and derivative works, subject to its conditions. Among other requirements:

• retain the Qwen copyright and permission notice in copies or substantial portions;
• comply with applicable laws and third-party intellectual-property rights;
• prominently display the applicable model name when the license's large-service threshold applies;
• obtain a separate Qwen license before certain commercial uses if the licensee or an affiliate conducts a Model-as-a-Service or AI Work Assistant business, as defined in the license.

Read the complete LICENSE; this summary is not a substitute for it and is not legal advice. No patent, trademark, endorsement, warranty, or other right is granted beyond the included license and applicable source terms.

The OrcaRouter source access notice states that the abliterated model is released strictly for legitimate research and that downloading or using it acknowledges the stated safety warning and responsibility. This gated repository preserves that notice and is intended for legitimate research, interpretability, AI-safety/refusal-mechanism study, red-teaming, robustness evaluation, and controlled experiments.

By requesting access to, downloading, or using this release, you acknowledge the safety notice above, accept the included Qwen Community License 1.0, and assume responsibility for lawful use and appropriate downstream safeguards.

Warranty disclaimer

The model, projector, metadata, documentation, and outputs are provided "AS IS", without warranty of any kind. To the maximum extent permitted by applicable law, the contributors and upstream authors disclaim liability for claims, damages, misuse, or other consequences arising from use. This notice does not limit obligations or rights that cannot legally be limited.