license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: any-to-any
base_model: DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking
tags:
- nightmedia
- gemma4
- gemma
- bf16
- mlx
gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-bf16
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
bf16 0.509,0.721,0.780,0.656,0.432,0.773,0.639
mxfp8 0.515,0.712,0.785,0.656,0.426,0.767,0.639
Quant Perplexity Peak Memory Tokens/sec
mxfp8 14.91 GB 1172
Baseline model
arc arc/e boolq hswag obkqa piqa wino
bf16 0.490,0.674,0.793,0.612,0.416,0.756,0.669
mxfp8 0.480,0.656,0.797,0.608,0.400,0.755,0.665
mxfp4 0.455,0.607,0.851,0.585,0.402,0.744,0.651
Quant Perplexity Peak Memory Tokens/sec
mxfp8 35.937 ± 0.525 14.80 GB 1153
mxfp4 36.746 ± 0.534 11.06 GB 1030
See parent model for instructions on install and use with Transformers.
-G