license: mit
tags:

• mimo
• mimo_v2
• mimo-v2-6-flash
• fp8
• mxfp4
• uncensored
• moe
• text-generation
• multimodal
• vision-language
• audio
• video-understanding
• long-context
• agent
• multi-token-prediction
  pipeline_tag: text-generation
  base_model: XiaomiMiMo/MiMo-V2.6-Flash-RL
  language:
• en
• zh
  library_name: transformers

MiMo-V2.6-Flash-RL — dealignai UNCENSORED edition

Compliance-tuned drop-in replacement for XiaomiMiMo/MiMo-V2.6-Flash-RL.
Refusal removed at the weight level. Vision, audio, and the DFlash speculative-decoding head fully preserved.
Both enable_thinking: true and enable_thinking: false supported.

Highlights

The 6 hard-refuses and 23 soft-redirects in thinking-ON are concentrated in copyright (75.00% comply) — verbatim-lyric / long-passage recall — and harmful (83.33% comply) — self-harm methods. Every other semantic category clears ≥ 96% compliance in both modes; both thinking-OFF and thinking-ON harassment_bullying clear 100%.

What Is This?

XiaomiMiMo/MiMo-V2.6-Flash-RL — the Flash tier of the MiMo-V2.6 release from Xiaomi: a 309B-total / 15B-active MoE (256 routed experts top-8, no shared expert) with a hybrid attention layout (9 global + 39 sliding-window-128), a vision-language encoder, an audio encoder, video understanding, ~1 M context length, and a DFlash 5-layer SWA speculative-decoding head shipped alongside for high-throughput inference — uncensored and shipped as a native-precision (FP8 attention + MXFP4 experts) MoE bundle.

Refusal behavior is removed at the weight level: the model follows instructions across task categories instead of refusing, while keeping its coding ability, math, knowledge, reasoning, and bilingual (EN + ZH) coverage intact. No runtime hooks, no steering vectors — a standard transformers / vLLM / SGLang-compatible bundle. Loads through vLLM's MiMo V2 loader (and SGLang's MiMo V2.6 loader) without patches.

No compliance-tuning internals are shipped inside this repository. No probe artifacts, no refusal vectors, no target-layer indices, no strength schedules, no surgery records. The bundle is only weights + config + tokenizer + assets + the base DFlash draft head.

Results

Multimodal preservation

• Vision — a 128×128 synthetic image containing a red circle, a blue square, a green triangle and the embedded caption CODE 7482 is described as: "three geometric shapes—a red circle, a blue square, and a green triangle—arranged in a row above the text 'COUNT. 3 SHAPES' and 'CODE 7482'" (shapes, colours, and embedded text all resolved correctly).
• Audio — a 3-tone 24 kHz mono sequence (440 Hz → 880 Hz → 220 Hz, 1 s each) is described as "A short electronic chime followed by a low buzzing tone" — the audio encoder resolves 2 of the 3 discrete tones. This matches base-model behavior; the encoder was not touched by the compliance tuning.

Both encoders are byte-identical to base — only decoder attention output projections were touched. The DFlash speculative-decoding head ships unchanged from the base repository under dflash/ and is loadable with the --speculative-config flag shown below.

Multi-turn coherence

The model handles multi-turn dependent tasks:

• Math chain (4 dependent turns: 47 × 63 → /3 → sqrt → ×8 + 100): correct end-to-end in both thinking modes, [2961, 987, 31.42, 351.36] in both — turn 4 propagates turn 3's result cleanly.
• Long-form generation (4-turn Tokyo heist story continuation, 2 stories × 4 turns = 8 turns total): all 8 turns coherent in thinking-ON mode, no repetition or attractor loops.

Intended use

• Red-team / defensive-security research on 15B-active reasoning MoEs.
• Compliance regression testing for safety-tuned deployments.
• Content-generation workflows that require the model to actually attempt every requested output.

What is NOT changed

• No steering vectors, no runtime hooks, no LoRA adapters. Standard transformers / vLLM / SGLang weights.
• Model architecture, tokenizer, chat schema, tool-call format, DFlash drafter, vision and audio encoders — all identical to base.
• MMLU non-ethics knowledge, coding, cyber, and general STEM (per-subject breakdown above).

Operational caveats

Read once, then forget — none of these block normal single-turn usage.

• Thinking-ON on verbatim-copyright / long-lyric recall — the extended reasoning trace re-engages an IP-deliberation loop on prompts that ask the model to reproduce copyrighted passages verbatim. Use enable_thinking: false for those requests, or accept the ~75% compliance on that specific slice. All other semantic categories clear ≥ 96% in both modes.
• Perfectly uniform images: a frame with a single flat color (no structure, no gradient) is base-model behavior for MiMo Flash's vision encoder — reported as "Blue" regardless of the actual color. Any real photo, screenshot, or one pixel of contrast avoids it. Unchanged by the compliance tuning.
• DFlash speculative decoding: preserved and functional on this bundle (measured acceptance rate above), but a couple of open upstream vLLM issues can bite specific workloads. If you see stalls or crashes with --speculative-config, drop the flag; the base autoregressive path is unaffected.

Serving instructions

GPU footprint. Non-KV weights land at roughly 88 GB per GPU at TP=2 (bf16-attn + fp8-dense + mxfp4-experts + drafter). Fits 2× H200 (141 GB), 2× RTX PRO 6000 Blackwell (96 GB) with tight KV headroom, or 8× H100-80GB at TP=8. 2× H100-80GB does not fit at TP=2 — weights alone exceed a single 80 GiB card. 2× DGX Spark (121 GB unified) works via SGLang over the direct 200 GbE ConnectX-7 link (see Spark section below).

Requires vLLM ≥ commit 4144ad2d for the MiMo V2 loader (mxfp4 MoE + bf16 router). Pre-built image vllm/vllm-openai:mimo-v26-cu129 is the reference build.

Hopper (H100-80GB / H200, sm_90) — recommended flags

docker run --gpus all --rm --ipc host --network host --shm-size 16g \
  -v /path/to/hf_home:/root/.cache/huggingface \
  -e VLLM_FLASHINFER_ALLREDUCE_BACKEND=trtllm \
  vllm/vllm-openai:mimo-v26-cu129 \
  vllm serve dealignai/MiMo-V2.6-Flash-RL-UNCENSORED \
    --served-model-name mimo-flash-uncensored \
    --tensor-parallel-size 2 --trust-remote-code \
    --enable-expert-parallel --distributed-executor-backend mp \
    --moe-backend marlin \
    --compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY","pass_config":{"fuse_allreduce_rms":false}}' \
    --gpu-memory-utilization 0.92 --max-model-len 262144 \
    --max-num-seqs 32 --max-num-batched-tokens 16384 \
    --reasoning-parser mimo --tool-call-parser mimo --enable-auto-tool-choice \
    --generation-config vllm --host 0.0.0.0 --port 8000

Measured on 2× H200 (TP=2, 32 k ctx): ~119 tok/s single-stream decode. --max-model-len can be raised on H200 up to the base support (~1 M positions); 32 k / 262 k are conservative starts.

Do NOT carry the Blackwell workarounds below to Hopper. Measured cost on H200 (4-probe A/B, one flag at a time):

Cold-start caveat (Hopper only). On a fresh pod with no warm DeepGEMM cubin cache, the JIT compile can fail with Assertion failed: !cubin.empty(). Set VLLM_USE_DEEP_GEMM=0 for that first boot — you lose the DeepGEMM path (measured cost above) but the model comes up on CUTLASS. Later boots with the cache populated (under /root/.cache/vllm/ or your VLLM_CACHE_ROOT) use DeepGEMM at full speed. Persistent volumes preserve the cache across pod restarts.

Blackwell workstation (RTX PRO 6000, sm_120) — required workarounds

export VLLM_USE_DEEP_GEMM=0
vllm serve dealignai/MiMo-V2.6-Flash-RL-UNCENSORED \
  --served-model-name mimo-flash-uncensored \
  --tensor-parallel-size 2 --trust-remote-code \
  --enable-expert-parallel --distributed-executor-backend mp \
  --disable-custom-all-reduce --linear-backend marlin --moe-backend marlin \
  --compilation-config '{"cudagraph_mode":"FULL_DECODE_ONLY","pass_config":{"fuse_allreduce_rms":false}}' \
  --gpu-memory-utilization 0.85 --max-model-len 32768 \
  --max-num-seqs 8 --max-num-batched-tokens 16384 \
  --reasoning-parser mimo --tool-call-parser mimo --enable-auto-tool-choice \
  --generation-config vllm --host 0.0.0.0 --port 8000

These three flags patch sm_120 kernel bugs: DeepGEMM sm_120 needs CUDA 13 (the cu129 image is CUDA 12.9), CUTLASS c3x FP8 sm_120 crashes, and Blackwell workstation NVLink layout mismatches the custom all-reduce kernel. --max-num-seqs 8 is a floor for TritonAttn during profile_run on sm_120 (crashes at 1; 2 also works).

2× NVIDIA DGX Spark (GB10 / sm_121) — SGLang over 200 GbE

The DGX Spark is Blackwell-class (sm_121) with 121 GB unified CPU+GPU RAM per node. The 178 GB Flash checkpoint requires two Sparks bridged over the ConnectX-7 200 GbE direct link (10.99.0.1 ↔ 10.99.0.2). Runtime: SGLang (has MiMo V2.6 day-0 support). vLLM does not yet drive a 2-node Spark cluster reliably.

Prereqs on both nodes:

1. lmsysorg/sglang:dev image loaded, commit ≥ 983e6438 for PR #40448.
2. Model directory in /home/eric/models/MiMo-V2.6-Flash-RL-UNCENSORED, byte-identical on both nodes (verify with sha256sum -c).
3. RoCE link autoconnect enabled: nmcli con mod enp1s0f1np1 connection.autoconnect yes.
4. Fix the upstream dflash/config.json trailing-comma JSON (breaks JSON5-strict loaders).
5. torchcodec ≥ 0.16.0+cu130 installed into a bind-mount dir on PYTHONPATH (the multimodal processor imports torchcodec; missing it silently blocks any serve start):

   docker run --rm -v /home/eric/mimo26/pyextra:/pyextra lmsysorg/sglang:dev \
     pip install --target /pyextra torchcodec
   

6. Add vision_config.qk_channels = 64 to config.json — the Flash checkpoint omits it and SGLang mimo_vl.py falls back to hidden_size / num_heads (wrong 40 vs required 64).

# HEAD (spark1, rank 0)
docker run -d --name mimo26-rank0 \
  --gpus all --ipc host --network host --shm-size 16g \
  --memory=115g --memory-swap=115g --oom-score-adj 1000 \
  --cap-add IPC_LOCK --ulimit memlock=-1:-1 --device /dev/infiniband \
  -v /home/eric/models:/models:ro \
  -v /home/eric/mimo26/pyextra:/pyextra:ro \
  -e PYTHONPATH=/pyextra \
  -e NCCL_IB_HCA=rocep1s0f1 -e NCCL_SOCKET_IFNAME=enp1s0f1np1 \
  -e GLOO_SOCKET_IFNAME=enp1s0f1np1 -e NCCL_IB_DISABLE=0 \
  -e PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True \
  lmsysorg/sglang:dev python3 -m sglang.launch_server \
    --model-path /models/MiMo-V2.6-Flash-RL-UNCENSORED \
    --served-model-name mimo-flash-uncensored \
    --trust-remote-code \
    --tp 2 --ep 2 --dp 1 --pp-size 1 \
    --nnodes 2 --node-rank 0 --dist-init-addr 10.99.0.1:29500 \
    --attention-backend triton --moe-runner-backend flashinfer_mxfp4 \
    --page-size 1 --disable-radix-cache \
    --mem-fraction-static 0.78 --swa-full-tokens-ratio 0.03 \
    --context-length 32768 --max-total-tokens 65536 \
    --max-running-requests 8 --cuda-graph-max-bs-decode 8 \
    --cuda-graph-backend-prefill=disabled \
    --speculative-algorithm DFLASH \
    --speculative-draft-model-path /models/MiMo-V2.6-Flash-RL-UNCENSORED/dflash \
    --speculative-num-draft-tokens 8 \
    --reasoning-parser mimo --tool-call-parser mimo \
    --host 0.0.0.0 --port 30000

# WORKER (spark2, rank 1) — same command, --node-rank 1

Non-optional GB10 flags (learned the hard way — omit any of these and you either OOM the node or get shape-mismatch crashes):

Memory hazard on GB10: unified memory has no swap protection. A hung load requires a physical power-cycle — the node will not respond to ssh. Run under the container --memory=115g cap and --oom-score-adj 1000 shown above. Do not launch unattended.

Measured on 2× Spark (single-stream, DFlash on, 8 concurrency): ~2.5 tok/s aggregate — slower than a 2× H200 pair by ~50× because the fabric is 200 GbE, not NVLink. Fine for evals, research, and single-user probing; not for production serving.

With DFlash speculative decoding (Hopper / Blackwell)

Add to either the Hopper or Blackwell flag block:

  --speculative-config '{"method":"dflash","model":"<snapshot>/dflash","num_speculative_tokens":7,"draft_tensor_parallel_size":2}' \
  --no-async-scheduling

The DFlash draft head is a 5-layer SWA drafter shipped in the base repo under dflash/. --no-async-scheduling is required — vLLM registers dflash in EagleModelTypes, so the auto-disable-async guard that fires for other spec methods does NOT fire here (vLLM #46669 shows DFlash + async at concurrency > 1 produces garbage output on MiMo). Correct flag spelling is --no-async-scheduling; --async-scheduling=False is a parse error, --async-scheduling False silently parses to True.

Note also vLLM #47930: DFlash acceptance collapses below 1% when prefix caching hits a shared long prefix. If your workload has tenant-shared prefixes, either drop --speculative-config or disable prefix caching for that path.

Thinking mode

Both modes are supported via the OpenAI-compatible extension:

client.chat.completions.create(
    model="mimo-flash-uncensored",
    messages=[{"role":"user","content":"..."}],
    max_tokens=1500,             # single-turn thinking-on
    extra_body={"chat_template_kwargs": {"enable_thinking": True}},
)

enable_thinking defaults to ON. Clients wanting fast turns must pass chat_template_kwargs.enable_thinking: false explicitly; leaving the field out will engage the reasoning path.

Read the reasoning trace from message.reasoning (vLLM 0.29+; older clients see the same content under message.reasoning_content). This bundle's chat template accepts either field on replay.

The bundle ships a chat template with a compact <think> prefill that keeps long reasoning traces from getting stuck in a "should I answer this" loop on high-taboo prompts. Reasoning depth is unchanged for benign prompts. The original template is preserved as chat_template.jinja.orig for auditability.

For stateful multi-turn conversations, enable_thinking: false is the safer default. The reasoning-ON path occasionally exhausts the token budget without closing </think> on multi-turn dependent tasks. repetition_penalty > 1.0 makes it worse — leave it at 1.0.

Sampling

Vendor defaults: temperature=1.0, top_p=0.95. All benchmarks in this card use greedy (temperature=0) unless noted.

Related

• Consolidated under a single UNCENSORED namespace — dealignai/MiMo-V2.6-Flash-RL-ABLITERATED is a redirect stub pointing here.
• Sibling release (larger tier, 1.02 T / 42 B active): dealignai/MiMo-V2.6-Pro-RL-UNCENSORED.

License

Inherits the MIT license of the base repository. Redistributing or fine-tuning further is permitted under those terms.

Support

If this bundle saves you a build, consider Ko-fi.