base_model: null-space/gemma-4-31b-it-abliterated
base_model_relation: quantized
license: apache-2.0
language:
- en
library_name: mlx
pipeline_tag: text-generation
tags: - abliterated
- uncensored
- gemma4
- gemma
- multimodal
- ablation
- mlx
- mlx-4bit
- mlx-lm
- apple-silicon
- local-llm
- on-device
- macbook
- 31b
- 4-bit
- gemma-4
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
model-index: - name: gemma-4-31b-it-abliterated-4bit-mlx
results: []
gemma-4-31b-it-abliterated-4bit-mlx
Uncensored Gemma 4 31B on Apple Silicon. Abliterated, 4-bit MLX, 17.3 GB — runs comfortably on a 32 GB Mac and flies on 64 GB+. No cloud, no API key, no refusals.
A 4-bit MLX quantization of null-space/gemma-4-31b-it-abliterated, tuned for fast on-device inference on Apple Silicon.
- Base model:
null-space/gemma-4-31b-it-abliterated(BF16, ~62 GB) - Quantization: 4-bit affine, group size 64
- Format: MLX safetensors
- Footprint: ~16 GB on disk, runs comfortably on a 32 GB Mac and flies on 64 GB+
- Throughput: ~15 tok/s on M4 Max (measured with
mlx-lm0.21+)
Why this exists
The default model in nicedreamzapp/claude-code-local used to point at a mlx-community/... repo that never actually existed. This is the real, working 4-bit quant — drop-in replacement.
Usage
from mlx_lm import load, generate
model, tokenizer = load("divinetribe/gemma-4-31b-it-abliterated-4bit-mlx")
print(generate(model, tokenizer, prompt="Hello", max_tokens=200))
Or via the launcher / setup script in claude-code-local:
MLX_MODEL=divinetribe/gemma-4-31b-it-abliterated-4bit-mlx \
bash scripts/start-mlx-server.sh
Abliteration
Refusal-direction projection per Arditi et al. (2024). Use responsibly — you are now the moderator.
About the author
This model was built by Matt Macosko (@nicedreamzapp) for the claude-code-local stack — run Claude Code 100% on-device with local AI on Apple Silicon (⭐ 2,664 on GitHub).
- 🤗 All my models: nicedreamzwholesale.com/software/huggingface/
- 💻 Software portfolio: nicedreamzwholesale.com/software/
- 🔒 AirGap AI (legal / healthcare / NDA workflows): nicedreamzwholesale.com/airgap/
More abliterated MLX models
Part of the Abliterated MLX for Apple Silicon
collection — 11 uncensored models converted for Macs, from Gemma 4 12B up to
Llama 3.3 70B, plus Qwen3, Qwen3-VL, Hermes 4 and Muse Glimmer 30B.
Part of Claude Code Local
This model is one of the fighters in Claude Code Local (3.2k★), which runs Claude Code 100% on-device on Apple Silicon through an MLX-native Anthropic-API server. Not sure which local model to run as an agent? Check the Agent-12 local agent leaderboard: real agent tasks, judged by the filesystem, same hardware for every row.
Built by Matt Macosko in Arcata, CA. Open to work on local-AI and Apple Silicon inference: [email protected].