license: apache-2.0
library_name: mlx
pipeline_tag: text-generation
tags:
- mlx
- optiq
- mixed-precision
- text-generation
base_model: ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive OptiQ 5bpw
Source: ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16
Original: HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Quantization
| Field | Value |
|---|---|
| Method | OptiQ mixed-precision MLX |
| Target BPW | 5 |
| Achieved BPW | 5.14 |
| Candidate bits | 4, 8 |
| Group size | 64 |
| Calibration | optiq (24 samples) |
| Model size | 18.42 GiB |
| Layer allocation | 54 high-bit / 337 low-bit |
| Layer policy entries | 391 |
Notes
- This is a text-only MLX export; vision components are omitted.
- Native MTP is disabled for this build.
- The original model is multimodal; this repository contains only the language model weights.
- Built from the bf16 source snapshot listed above.
Usage
huggingface-cli download dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX --local-dir Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX
python -m mlx_lm.generate --model Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX --prompt "Write a short greeting."