library_name: mlx
tags:
- mlx
- oq
- quantized
- mtp
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-oQ4h-mtp
[!NOTE]
Updated 2026-11-19: Re-quantized with oMLX v0.8.0. Please re-download if you have an earlier copy.
This model was quantized using oQ (oMLX v0.8.0) mixed-precision quantization.
The effective average is 13.759 bits/weight for the complete checkpoint.
Quantization and Bit Distribution
| Storage format | Logical weights | Share of total | Tensor storage | Effective bits/weight |
|---|---|---|---|---|
| Affine 4-bit, group 64 | 1.156B | 30.458% | 0.605 GiB | 4.50 |
| Affine 5-bit, group 64 | 0.071B | 1.879% | 0.046 GiB | 5.50 |
| Affine 6-bit, group 64 | 1.017B | 26.810% | 0.770 GiB | 6.50 |
| BF16 | 0.600B | 15.816% | 1.118 GiB | 16.00 |
| U32 | 0.950B | 25.037% | 3.538 GiB | 32.00 |
| Total | 3.794B | 100% | 6.077 GiB | 13.759 |
Storage Breakdown
| Component | Logical weights | Storage |
|---|---|---|
| Language model | 3.095B | 5.419 GB / 5.047 GiB |
| Vision | 0.456B | 0.912 GB / 0.849 GiB |
| MTP head | 0.243B | 0.194 GB / 0.181 GiB |
| Total | 3.794B | 6.525 GB / 6.077 GiB |