← back to catalog · registered 2026-10-18 06:00

Loke-60000/Qwen3.8-Flash-Next-FP4-Local-abliterated

Loke-60000 multimodal
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Loke-60000%2FQwen3.8-Flash-Next-FP4-Local-abliterated"
Response includes
  • classification m-uncensored
  • files 12
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-10-17

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Tags
safetensors qwen4_exp abliterated uncensored Qwen3.8 FP4 nvfp4 image-text-to-text conversational base_model:nvidia/Qwen3.8-Flash-Next-FP4-Local base_model:finetune:nvidia/Qwen3.8-Flash-Next-FP4-Local license:other

Related

Total size
0 B
Files
12
Quantizations
1
Registered
2026-10-18 06:00
Last updated on HF
2026-10-18 05:43

Files by quantization

Auxiliary files 12 files 67.0 MB
model.safetensors.index.json 45.1 MB ******** download
tokenizer.json 12.2 MB ******** download
vocab.json 6.41 MB 0aa0ce06 download
merges.txt 3.20 MB a494e019 download
config.json 73.5 KB 1efa9baa download
tokenizer_config.json 17.5 KB 5de744b3 download
chat_template.jinja 8.74 KB c0c686f9 download
README.md 6.50 KB 83ac3878 download
.gitattributes 1.60 KB aa7aacd0 download
preprocessor_config.json 390 B 2ea84a43 download
video_preprocessor_config.json 385 B 3ba673a5 download
generation_config.json 202 B 023756cf download

README current version from Hugging Face


pipeline_tag: image-text-to-text
base_model:

  • nvidia/Qwen3.8-Flash-Next-FP4-Local
    base_model_relation: finetune
    license: other
    license_name: nvidia-open-model-agreement
    tags:

  • abliterated

  • uncensored

  • Qwen3.8

  • FP4

  • nvfp4
    gated: auto
    extra_gated_heading: "Acknowledge the terms to access this model"
    extra_gated_prompt: |
    This model has had its refusal behaviour removed and is provided as is, without warranty of any kind.
    By requesting access you agree that:

    1. You are responsible for its use. You alone are responsible for how you use this model and for
      everything it produces, including content you publish, share or act on.
    2. That includes automated use. If you run the model inside an agent, pipeline or any automated
      system, you are responsible for that system's actions and their consequences, as if you had taken
      them yourself.
    3. It will not push back. Unlike the base model, it may carry out instructions that are illogical,
      mistaken or dangerous instead of questioning or refusing them, for example deleting files, wiping
      data, running destructive commands or sending messages it should not. Do not rely on the model as a
      safeguard. Give agents the narrowest permissions they need, sandbox them, keep backups, and require
      human confirmation before irreversible actions.
    4. Use it lawfully and respectfully. Follow the laws that apply to you, and do not use the model to
      harass, deceive, or cause harm to people.
    5. It can be wrong. Outputs may be inaccurate, offensive or unsafe. Check them before relying on them.
    6. The authors are not liable for any damage, data loss, loss of access, or any other loss or claim
      arising from your use of the model or its outputs.
      extra_gated_button_content: "I agree and accept responsibility"
      extra_gated_fields:
      Name: text
      Intended use:
      type: select
      options:
      • Research
      • Personal projects
      • Agent / automation
      • Other
        I take full responsibility for my use of this model and for any agent or system I run it in: checkbox
        I understand it may follow harmful or destructive instructions and I will add my own safeguards: checkbox
        I will use this model lawfully and respectfully: checkbox

Qwen3.8-Flash-Next-FP4-Local-abliterated

nvidia/Qwen3.8-Flash-Next-FP4-Local (revision b9ce18a) with two refusal directions projected out of the residual-stream writers. The quantization format is unchanged, so it runs anywhere the base checkpoint runs.

Warning: this model's refusal behavior has been removed, so it will carry out requests the base model would decline, including mistaken or destructive ones such as deleting data. You are responsible for how you use it. If you run it in an agent, give it only the permissions it needs, run it in a sandbox, keep backups, and require human confirmation before anything irreversible.

Files in this repo

This repo holds only the weights that were edited: the 2 changed shards (tensors/model-00001-of-00021.safetensors and tensors/model-00015-of-00021.safetensors), plus the base model's config, tokenizer, chat template and shard index. The other 19 shards are byte-identical to the base and are not included, so this repo does not load on its own.

To get a complete checkpoint, download the base model from NVIDIA at the pinned revision, then put the two shards from this repo in place of the base's copies:

hf download nvidia/Qwen3.8-Flash-Next-FP4-Local --revision b9ce18a6887e18c089fdea8509a33e63429a3300 --local-dir Qwen3.8-Flash-Next-FP4-Local-abliterated
hf download Loke-60000/Qwen3.8-Flash-Next-FP4-Local-abliterated --local-dir Qwen3.8-Flash-Next-FP4-Local-abliterated

The second command overwrites the two edited shards and leaves the other 19 untouched. Use the same revision: the edited shards are built against b9ce18a and will not match other revisions of the base. Downloading the base is subject to NVIDIA's terms for that model.

The weights in this repo may or may not be updated in the future.

What changed

Only 80 tensors were edited, all in layers 8 to 47:

  • linear_attn.out_proj and self_attn.o_proj (attention writers)
  • mlp.shared_expert.down_proj

Everything else is byte-identical to the base: routed experts, embeddings, n-gram table, MTP head, vision tower, lm_head. Only 2 of the 21 shards differ (tensors/model-00001-of-00021.safetensors and tensors/model-00015-of-00021.safetensors).

Method

  1. Directions. Two refusal directions were recovered from leimroth-lab/Unbound-LR7 by dequantizing its edited 4-bit writers and diffing them against the stock MLX 4-bit base. The summed difference is cleanly rank 2 (eigenvalues 1.00, 0.91, then 0.02). The directions were not re-measured on the FP4 weights.
  2. Edit. W' = W - R diag(λ) Rᵀ W with λ = 1.75 on attention writers and 0.5 on the shared expert (the strengths from LR7).
  3. Requantization. Each writer was dequantized from MXFP8 (E4M3 values, E8M0 block scales, group 32), edited in fp32, then requantized over 8 iterations that correct the realized projection so the edit survives rounding. The realized strengths are 1.72 (attention) and 0.46 (shared expert), with about 1.8% requantization noise.

Usage

Same as the base model. The NVFP4 scale factors use NVIDIA's compressed format, which upstream vLLM does not support yet, so use the containers listed on the base model card. This checkpoint was tested on a DGX Spark with a TensorFold FP4 build at a 65,536-token context, 2 streams, fp8 KV cache, MTP drafts on, vision off.

Thinking is on by default (the chat template's default). Pass chat_template_kwargs: {"enable_thinking": false} to turn it off per request.

Limitations

  • No benchmarks or quality evaluations have been run, for refusals or otherwise.
  • The strengths come from LR7 and were not tuned for this checkpoint.
  • Vision was not tested after the edit. The vision tower itself is untouched.
  • Removing refusals does not make the model more accurate. It can still be wrong, confidently.

License

This is a derivative of NVIDIA's checkpoint of Alibaba's Qwen3.8-Flash-Next and is subject to both the NVIDIA Open Model Agreement and the Qwen Community License 1.0. See the base model and Qwen/Qwen3.8-Flash-Next for the full terms.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration