base_model: zecanard/gemma-4-26B-A4B-it-uncensored-heretic-ara-MLX-8bit-int8-affine
language: en
library_name: mlx
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: image-text-to-text
tags:
- mlx
- heretic
- uncensored
- decensored
- abliterated
- ara
🦆 TheDrewBenson/gemma-4-26B-A4B-it-uncensored-heretic-ara-MLX-8bit-int8-affine-betterCache
This model builds on zecanard/gemma-4-26B-A4B-it-uncensored-heretic-ara-MLX-8bit-int8-affine, which was converted to MLX from trohrbaugh/gemma-4-26B-A4B-it-heretic-ara using mlx-vlm version 0.6.3.
Please refer to zecanard's model card or the original model card for more details.
🌟 Quality
Quantized vision language model with an effective 9.163 bits per weight.
mlx_vlm.convert --quantize --q-group-size 32 --q-bits 8 --q-mode affine
🛠️ Customizations
This quant includes a bugfix for tools calling. It is aware of the current date, and also enables thinking (if available). You may disable this behavior by deleting the following line from the chat template, or changing true to false:
{%- set enable_thinking = true %}
You may need to adjust your environment’s Reasoning Section Parsing to recognize <|channel>thought as the Start String, and <channel|> as the End String.
Prompt-caching fix
We built on top of zecanard's work, removing the current time of day from the
chat template's date line to allow for prompt caching. The original template
rendered The current date is: ... down to the second (plus a raw Unix
epoch value) as the very first thing in every prompt, so it changed on every
single request and prevented any prefix/KV cache reuse between turns — every
request paid full prompt-processing cost no matter how much of the
conversation was unchanged. This fork renders date-only, so the line stays
stable across requests made on the same day and cache hits work normally
again, with no observable change in model behavior.
🖥️ Use with mlx
pip install -U mlx-vlm
mlx_vlm.generate --model TheDrewBenson/gemma-4-26B-A4B-it-uncensored-heretic-ara-MLX-8bit-int8-affine-betterCache --max-tokens 100 --temperature 0 --prompt "Describe this image." --image <path_to_image>