library_name: ninfer
pipeline_tag: image-text-to-text
license: apache-2.0
base_model: ukisai/Swift-Qwen3.8-27b
tags:

• ninfer
• nvfp4
• qwen3.8
• qwen3_5
• abliterated
• uncensored
• multimodal
• mtp
• speculative-decoding
• blackwell
• cuda
• sm_120a

Swift-Qwen3.8-27B · huihui-style abliterated · NVFP4 · NInfer

A 27.78B-parameter multimodal derivative of
ukisai/Swift-Qwen3.8-27b, abliterated in the
huihui-ai style, quantized to
NVFP4 + FP8 for the NInfer engine
on Blackwell (sm_120a).

Why this exists

Swift-Qwen3.8-27b is a strong multimodal Qwen3.8-27B checkpoint, but it still carries the
refusal direction of the base model. The huihui abliteration removes that direction
(Arditi et al. 2024, refusal-projection family), and the NInfer NVFP4 build makes the result
runnable on a single Blackwell card at ~20 GB. This repository is the end-to-end product of
that chain: Swift → huihui-style abliteration → NVFP4 → NInfer, built and
verified on one GPU box, with every step recorded in NOTICE.

Quickstart

The artifact runs with the NInfer CLI or ninfer-serve (requires the
ninfer runtime at revision ≥ 52320554b5e7,
CUDA ≥ 13.1, an sm_120a build):

# one-shot
ninfer qwen3_8_27b_swift_abliterated_nvfp4.ninfer \
  --prompt "Tell me something interesting about the universe." \
  --max-context 16384 --max-new 512 --no-thinking

# with MTP speculative decoding
ninfer qwen3_8_27b_swift_abliterated_nvfp4.ninfer \
  --prompt "Write a haiku about a GPU cluster at 3am." \
  --max-context 16384 --max-new 256 \
  --spec mtp --draft-tokens 5 --lm-head-draft --no-thinking

# serving
ninfer-serve qwen3_8_27b_swift_abliterated_nvfp4.ninfer --port 8088

It is a multimodal model (image-text-to-text); the full Qwen3.8-27B vision tower and MTP
head are included in the artifact.

Measured on this artifact

Refusal probe: standard refusal-prefix heuristic over the first 400 characters of greedy
completions on the first 20 AdvBench harmful_behaviors prompts (no content is stored, only
verdicts).

Provenance

Reproduction

1. scripts/fetch_source.sh (in the build log) downloaded the three BF16 checkpoints (Xet-free,
   size-verified, resumable).
2. The abliteration step applied W_swift + (W_huihui - W_base) to exactly the tensors the
   reference abliteration modified; all other tensors are byte-identical to Swift.
3. recipe/quantize_nvfp4.py ran llm-compressor oneshot (CPU-resident, ~8 GB VRAM peak).
4. The NInfer engine was built for sm_120a and convert_nvfp4.py produced the artifact;
   verify_artifact.py confirmed the 1124-object contract before anything was published.

Frontend disclosure

Frontend gate was satisfied without substitution (all six files already canonical).

License

Apache-2.0, matching the base checkpoint. See LICENSE and NOTICE.