← back to catalog · registered 2026-10-19 09:00

KaedeTai/qwen3.8-flash-next-swift-uncensored-mtp-mlx-4bit-zhTW

KaedeTai MoE multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/KaedeTai%2Fqwen3.8-flash-next-swift-uncensored-mtp-mlx-4bit-zhTW"
Response includes
  • classification m-uncensored
  • files 36
  • author_summary 3 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-10-19

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Languages
zh en
Tags
mlx safetensors qwen4_exp omlx mtp speculative-decoding qwen3_8 mixture-of-experts abliterated uncensored traditional-chinese zh-tw

Related

Total size
95.1 GB
Files
36
Quantizations
1
Registered
2026-10-19 09:00
Last updated on HF
2026-10-19 07:19

Files by quantization

Auxiliary files 36 files 95.1 GB
model-swift-00011.safetensors 4.75 GB ******** download
model-swift-00010.safetensors 4.74 GB ******** download
model-swift-00013.safetensors 4.74 GB ******** download
model-swift-00008.safetensors 4.74 GB ******** download
model-swift-00005.safetensors 4.74 GB ******** download
model-swift-00007.safetensors 4.74 GB ******** download
model-swift-00004.safetensors 4.73 GB ******** download
model-swift-00002.safetensors 4.73 GB ******** download
model-swift-00009.safetensors 4.70 GB ******** download
model-swift-00012.safetensors 4.69 GB ******** download
model-swift-00006.safetensors 4.69 GB ******** download
model-swift-00003.safetensors 4.69 GB ******** download
model-swift-00001.safetensors 4.69 GB ******** download
model-ple-00007.safetensors 4.66 GB ******** download
model-ple-00006.safetensors 4.66 GB ******** download
model-ple-00004.safetensors 4.66 GB ******** download
model-ple-00005.safetensors 4.66 GB ******** download
model-ple-00003.safetensors 4.66 GB ******** download
model-ple-00002.safetensors 4.66 GB ******** download
model-swift-00014.safetensors 3.93 GB ******** download
model-ple-00008x.safetensors 1.63 GB ******** download
model-ple-00001x.safetensors 238 MB ******** download
tokenizer.json 12.2 MB ******** download
vocab.json 6.41 MB 0aa0ce06 download
merges.txt 3.20 MB a494e019 download
model.safetensors.index.json 377 KB 284d4ddf download
config.json 230 KB 31841083 download
generation_config.json 215 KB ae591740 download
tokenizer_config.json 17.5 KB 5de744b3 download
LICENSE 13.0 KB bfbc26b4 download
chat_template.jinja 9.49 KB 269f53c9 download
README.md 8.00 KB b1751a02 download
NOTICE 5.33 KB afd81b7f download
LICENSE-QWEN 3.16 KB 9557a896 download
.gitattributes 1.53 KB 52373fe2 download
preprocessor_config.json 390 B 2ea84a43 download

README current version from Hugging Face


license: other
license_name: swift-open-license-1.0
license_link: LICENSE
base_model:

  • jessedye90/qwen3.8-flash-next-swift-uncensored
    base_model_relation: quantized
    pipeline_tag: image-text-to-text
    library_name: mlx
    language:
  • zh
  • en
    tags:
  • mlx
  • omlx
  • mtp
  • speculative-decoding
  • qwen4_exp
  • qwen3_8
  • mixture-of-experts
  • abliterated
  • uncensored
  • traditional-chinese
  • zh-tw
  • apple-silicon
  • 4-bit
    extra_gated_prompt: >-
    This model has had its safety refusals removed (abliteration). It will comply with harmful requests that the
    original model refuses. By requesting access you agree to use it only for lawful purposes, to add your own safety
    and moderation layers before any deployment, to accept full responsibility for how you use it and everything it
    generates, and to comply with the Swift Open License v1.0 (including its commercial-use limitation) and the Qwen
    Community License 1.0.

Swift 1.5 Qwen3.8-Flash-Next Uncensored · MLX 4-bit MTP · zh-TW

An MLX build of jessedye90/qwen3.8-flash-next-swift-uncensored
(UkisAI's Swift 1.5 fine-tune of Qwen3.8-Flash-Next, with the refusal direction removed) for Apple silicon. The native
MTP head is kept for speculative decoding, the n-gram (PLE) table is included so the checkpoint is self-contained, and
generation is tuned to Taiwan Traditional Chinese without retraining any weight.

  • Lossless where it matters. The source is GPTQ W4A16. Its INT4 routed experts, attention and DeltaNet projections,
    the INT8 lm_head and the INT4 MTP drafter modules are repacked, not re-quantized: the integer codes are copied
    bit-for-bit into MLX affine quantization with the same bits and group size, and only the fp16 scales are rounded to
    bfloat16. The source's abliteration was made inside those INT4 grids; re-quantizing would partly undo it, repacking does not.
  • zh-TW: 27,640 tokens containing Simplified-only characters are suppressed (generation_config.json), and the chat
    template adds a short Taiwan-usage note.
  • Measured on 20 prompts: Simplified characters 3.0 % → 0 %, Mainland terms 17 → 7, English prompts still answered in English.
  • Size: 102 GB in 22 files (70 GB weights + 32 GB PLE table). On a 128 GB Mac oMLX keeps ~66 GB resident and reads the PLE table from SSD.

Runtime

Requires a runtime with qwen4_exp and its native MTP block — tested with oMLX 0.7.0 on an M5 Max (128 GB).
In the model settings enable:

setting value why
mtp_enabled true native MTP speculative decoding (acceptance ≈ 95 %, ~3 tokens per step in our runs)
qwen4_ple_ssd_offload true keeps the 32 GB n-gram table on SSD

Conversion

conversion/convert_swift.py streams the source repo one shard at a time and writes the oMLX qwen4_exp layout
(per-expert tensors stacked into switch_mlp). Per tensor family:

source format tensors here
GPTQ INT4 g128 (sym) routed experts, self_attn q/k/v/o, linear_attn in_proj_qkv / in_proj_z / out_proj MLX 4-bit g128, codes repacked
GPTQ INT8 g128 lm_head MLX 8-bit g128, codes repacked
GPTQ INT4 g32 MTP fc_*, attention and shared expert MLX 4-bit g32, codes repacked
FP8 block (128×128) shared_expert gate/up/down MLX 8-bit g128
BF16 hyper-connection mixers, indexer, DeltaNet a/b, gates, embed_tokens, MTP routed experts MLX 4–8-bit, same bits as our oQ4e build of Qwen3.8-Flash-Next
BF16 norms, conv, A_log, vision tower unchanged

GPTQ v1 zero points (stored as 2^(bits-1) − 1) become MLX biases −scale × 2^(bits-1); scales are rounded from float16 to bfloat16 (relative error ≤ 0.2 %).
conversion/swift_conversion_report.json lists every module with its source format, bits, group size, and cosine
similarity to the corresponding tensor of our oQ4e build of OrcaRouter's abliterated Qwen3.8-Flash-Next (0.96–1.0;
routed experts ≈ 0.99, the expected gap between two 4-bit quantizations of closely related weights).

The source repo does not include the n-gram (PLE) table; the copy here (MLX 4-bit, group 32) comes from our oQ4e build of
orcarouter/Qwen3.8-Flash-Next-Uncensored-FP8.
Tokenizer files are the original Qwen3.8-Flash-Next ones (same 248,044-token vocabulary as the source; the source's
re-serialized tokenizer.json drops \p{M} from the pre-tokenizer regex).

What makes it Traditional Chinese

Same method as KaedeTai/Qwen3.8-Flash-Next-Uncensored-oQ4e-mtp-zhTW:

  1. Simplified-only tokens are suppressed. A token is in suppress_tokens when it contains a character that OpenCC
    s2tw maps to a different Taiwan form and that is essentially absent from Taiwanese text (Wikinews zh-TW and a
    CC-100 zh-Hant shard). 1,202 characters → 27,640 tokens. Characters legitimate in Taiwan usage (后, 里, 台, 干, 才,
    于, 云, 准, 托, 余, 范, 征 …) are kept. List and scripts: zhtw/. Consequence: this build cannot write Simplified Chinese.
  2. A Taiwan-usage note in the chat template, phrased in English so English questions are still answered in English.
    Turn it off per request with chat_template_kwargs: {"zhtw_style": false}.

Evaluation

20 prompts (zhtw/eval_zhtw.py): 16 Chinese, 2 Chinese under an English agent-style system prompt, 2 English.
Greedy decoding, max_tokens 400, thinking off, oMLX 0.7.0, M5 Max, MTP on, on a shared server with another model loaded.

Simplified characters Mainland terms English prompts median speed
same weights, no zh-TW changes 144 / 4,737 (3.0 %) 17 English 51 t/s
this build 0 / 4,766 7 English 54 t/s

Raw outputs: zhtw/eval_baseline.json, zhtw/eval_zhTW.json. Refusal behaviour was not re-measured after conversion;
see the source model card for its AdvBench / XSTest results.

Disclaimer

Safety alignment has been removed by abliteration. The model will comply with harmful, unethical or illegal requests
that the original model refuses. It is provided for research, red-teaming and private use; you are responsible for how
you use it and for everything it generates. Add your own safety layers before exposing it to anyone else.

License and attribution

  • Swift Contribution by UkisAI: Swift Open License v1.0 (LICENSE), including its commercial-use limitation —
    commercial use by an entity with US$1,000,000 or more in annual gross revenue needs a separate Swift Enterprise License
    from UkisAI.
  • Base model Qwen3.8-Flash-Next, Copyright (c) 2026 Qwen: Qwen Community License 1.0 (LICENSE-QWEN).
  • Abliteration by jessedye90 using OrcaRouter's refusal direction. Attribution and change notices, including the ones
    for this conversion, are in NOTICE.

This is a community conversion. It is not made or endorsed by UkisAI, Qwen, OrcaRouter or jessedye90.


中文摘要

這是 UkisAI Swift 1.5(Qwen3.8-Flash-Next 微調版)無審查版的 MLX 4-bit 版本,保留 MTP 推測解碼,並針對台灣繁體中文調整:

  • **不重新量化:**原始檔的 GPTQ INT4/INT8 權重(routed experts、注意力、DeltaNet、lm_head、MTP)整數碼逐位元搬進 MLX 格式,只有 scale 從 fp16 轉成 bf16,保留原作者在 INT4 格點上做的去審查修改。
  • **自帶 PLE 表:**原 repo 沒附 n-gram 表,這裡一併提供,下載即可用。
  • **禁止簡體字+台灣用語提示:**封鎖 27,640 個含簡體專用字的 token,對話範本加上台灣用語提示。實測簡體字 3.0% → 0%,大陸用語 17 → 7,英文題照常用英文回答。這一版無法輸出簡體中文。
  • **需求:**oMLX 0.7.0 以上,開啟 mtp_enabled 與 qwen4_ple_ssd_offload。128 GB 的 Mac 上常駐記憶體約 66 GB。
  • **授權:**Swift Open License v1.0(年營收 100 萬美元以上的公司商用需另取授權)+ Qwen Community License 1.0。
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration