license: apache-2.0
base_model:
- AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16
base_model_relation: quantized
library_name: mlx
pipeline_tag: image-text-to-text
tags: - mlx
- mxfp4
- qwen3.5
- qwen3.8
- abliterated
- experimental
- mlx-vlm
- vision
- mtplx
- speculative-decoding
- multi-token-prediction
qwen3.8-27b-aeon-ultimate-uncensored-mxfp4-vision-mtplx
Independent MXFP4 MLX conversion of
AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16, pinned at a6775a9a8ebb65cab3f707b4ab087fc7aa698634.
This is a community conversion, not an official AEON-7 or Qwen release.
Format
- Language quantization: MXFP4, 4-bit, group size 32
- Vision: 333 source BF16 tensors preserved; patch embedding converted to MLX axes
- Indexed artifact size: 14.98 GiB
- Architecture: dense Qwen3.5-family hybrid attention/GDN, 64 language layers
- Configured context: 262,144 tokens (not exhaustively qualified here)
- Tokenizer, chat template, processor metadata, and Apache-2.0 lineage preserved
MTPLX
This package adds the pinned source checkpoint's 15 native BF16 MTP tensors to
the paired vision MLX body. Tensor parity, strict MTPLX inspection, a local
AR/D1/D2/D3 tune, and deterministic text/vision smokes passed.
- Local selected depth: D2; decode: 52.67 tok/s; multiplier vs AR: 1.861x; verdict:
mtp-faster-than-ar
Runtime speed and acceptance depend on host, prompt, context, and MTPLX version;
benchmark locally before selecting speculative depth.
mtplx inspect --json --require-mtp <local-path-or-repo-id>
mtplx tune --model <local-path-or-repo-id> --depths 1,2,3 --json
Qualification and limitations
- Pinned source metadata and all safetensors headers were checked.
- Quantization used the fixture-matched Qwen3.5 streaming adapter from MLX-LM 0.31.3.
- MXFP4 and MXFP8 were each produced directly from the same BF16 parent.
- Structural inspection and strict local load are required release gates.
This is an experimental quantization of an abliterated, intentionally unaligned
checkpoint. Quantization does not restore safety alignment. The source publisher
warns that the model can produce unsafe or illegal material and places downstream
safety and legal responsibility on operators. Review the
source model card before use and add access
controls, logging, moderation, and human review appropriate to your deployment.
Basic use
python -m mlx_vlm.generate --model <repo-or-path> --image image.jpg --prompt "Describe this image." --max-tokens 256
Shiftedx Bench post-publication qualification
This table was generated from the frozen lightweight quant gate after the model weights were published. Categories remain separate; the benchmark does not produce a composite intelligence score.
| Lane | Passed | Accuracy | Mean wall time | Mean decode | Peak active memory |
|---|---|---|---|---|---|
| Quality | 8/10 | 80.0% | 21.53 s | 55.22 tok/s | 31.21 GiB |
| Long context | 15/15 | 100.0% | 141.22 s | 43.52 tok/s | 42.23 GiB |
| Tool calling | 6/6 | 100.0% | 4.61 s | 47.30 tok/s | 34.03 GiB |
| Agentic | 2/2 | 100.0% | 15.92 s | — tok/s | — |
| Vision | 4/4 | 100.0% | 3.81 s | 53.76 tok/s | 35.17 GiB |
- Tested model revision:
ff85b7fb563a642bbcbe9645789e11ed496be885 - Benchmark: Shiftedx Bench v0.3.0
- Context lengths represented: 4,096, 16,384, 65,536, 131,072 prompt tokens; effective tested context: 131,072 tokens
- Runtime contract: MTPLX 2.7.1 sustained; thinking on/medium; sampler temperature=1.0, top_p=0.95, top_k=20; Hermes hybrid routing with native explicit-parallel calls; KV cache
off; MTP depth2 - Host: Apple M4 Max, 64 GiB unified memory
- Total measured request wall time: 2408.23 seconds
- 260,096-token status: not run; it is outside the lightweight quant gate.
Scores are specific to the linked model revision, benchmark revision, runtime contract, and host. Changing weight precision, KV-cache precision, reasoning mode, template, or speculative depth creates a different benchmark candidate.