license: other
license_name: lil-license-1.0
license_link: LICENSE
base_model:
- local-inference-lab/Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD
- lflare/Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD-Abliterated
tags: - flare
- hyperflare
- qwen3.8
- nvfp4
- abliterated
Qwen3.8-Flash-Next HyperFlare A16 Abliterated 1M
This model is based on Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD by Local Inference Lab, Inc., a non-profit organization, available at https://huggingface.co/local-inference-lab/Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD. Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD is licensed under the Local Inference Lab License, Version 1.0.
A prepared Flare runtime core of the abliterated Qwen3.8-Flash-Next checkpoint, for serving with the HyperFlare engine image ghcr.io/raydius/hyperflare-inference.
What this is
| Weights | lflare/Qwen3.8-Flash-Next-NVFP4-MXFP8-CSF-QAD-Abliterated tag v3, built on Local Inference Lab revision dc5b8ab2; weight bytes unchanged |
| Hardware | One NVIDIA SM120 GPU with 96 GB (RTX PRO 6000 Blackwell); the core reserves 73.12 GiB of device memory |
| Context | 1,048,576 tokens |
| Concurrency | 16 requests, one rank |
| Speculation | MTP, widths 1–8 |
| Publisher | raydollete; the verification key is publisher.json in this repository |
Run
The core runs only in Flare. Use the HyperFlare image; it carries the serving options this core was prepared and tested with.
docker volume create flare-home
docker run --rm -it --name flare \
--gpus 'device=0,capabilities=compute' \
--security-opt seccomp=unconfined \
--ulimit memlock=-1:-1 --ipc host --shm-size 8g \
--stop-timeout 60 \
-p 127.0.0.1:8000:8000 \
-v flare-home:/home/flare \
ghcr.io/raydius/hyperflare-inference:0.2.5 \
run raydollete/Qwen3.8-Flash-Next-HyperFlare-A16-Abliterated-1M \
--gpus 0 --host 0.0.0.0 --port 8000
The first run downloads the core (about 99 GB) into the volume and asks you to accept the raydollete publisher once, which also accepts the license named in the core. The volume keeps the download and the acceptance across container restarts. seccomp=unconfined is required: the core reads its embedding tables through io_uring, which Docker's default seccomp profile blocks (Engram io_uring: Operation not permitted). The server exposes an OpenAI-compatible API on port 8000.
License
This repository is a re-upload of a Substantially Similar Copy under the Local Inference Lab License, Version 1.0, made with the permission of Local Inference Lab, Inc. That permission does not extend to you: you may download and run this core, but you may not re-upload it or any Substantially Similar Copy. Read LICENSE and NOTICE before use.
The Qwen3.8-Flash-Next base model is governed by the Qwen Community License 1.0. The license name recorded inside the core, which Flare shows at acceptance, is nvidia-open-model-agreement, carried from the source checkpoint's model card; this repository's LICENSE and NOTICE state the binding terms.
The abliteration is lflare's work; see that repository for its method and measurements.