For privacy reasons a browser tells us at most
"≥ 8 GB RAM, 8 cores" - same reading whether you have 8 GB
or 128 GB. It has no idea how much RAM is free right now, which
apps are open, or whether you have a GPU.
The Abliteration app is integrated with your machine
It reads your exact RAM, GPU model and VRAM,
free memory right now, and picks the sharpest quant that
still fits. Every model page lights up precisely for your rig.
And you can chat with any model, right now
The app is a full local runtime - no API keys, no subscription,
everything runs on your machine. Click any model on this site and
start a conversation in seconds.
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
'abliterated' in name/tags
is_gguf=0 (base model)
no specific method indicators - defaulting to M1 (most common)
This model is a DQ4 quantized version of the original model [GLM-5-abliterated](Local Model). It was quantized locally using the mlx_lm library.
Quantization Methodology (DQ4)
This model was quantized using the dynamic DQ4 (4-bit / 5-bit / 6-bit / 8-bit mixed) approach, inspired by the methodology described in the mlx-community/Kimi-K2.5-mlx-DQ3_K_M-q8 repository.
The weights are mixed based on MLX layers:
Expert layers (switch_mlp / mlp) are quantized to 4-bit.
The first 5 layers are kept at higher quality (6-bit).
Every 5th layer is medium quality (5-bit).
All other layers (e.g. attention, normalization) remain at 8-bit to serve as the "8-bit brain".
README history
1 version
The author's README evolved over time. Click a version to see its content at that point.
2026-03-16Add files using upload-large-folder toole01209d828 B
Loading...
Catalog is the map. Apps are the tools.
Run models on your own machine, not in the cloud.
Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.