← back to catalog · registered 2026-08-22 13:56

nightmedia/gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-mxfp8-mlx

nightmedia Gemma 7.5B second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/nightmedia%2Fgemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-mxfp8-mlx"
Response includes
  • classification m3
  • files 11
  • hub_downloads_all_time 4,187
  • author_summary 51 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · lifetime
4K
47 last 30d - cooling
Likes
1
Model age
6mo ago
created 2026-04-07
Downloads over time
Now4.2K→from2.5K↑65%
2.5K3.1K3.7K4.4K2.5K on Apr 154.2K on Oct 114.2K on Oct 7AprMayJunJulAugSepOct
Apr 15 → Oct 11 · 65 snapshots · spans 179 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
mlx safetensors gemma4 nightmedia gemma google mxfp8 any-to-any base_model:DavidAU/gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking base_model:quantized:DavidAU/gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking license:apache-2.0 8-bit

Related

Total size
8.23 GB
Files
11
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-04-13 23:18

Files by quantization

Auxiliary files 11 files 8.26 GB
model-00001-of-00002.safetensors 4.58 GB 55b7970d download
model-00002-of-00002.safetensors 3.64 GB 3b0d09b0 download
tokenizer.json 30.7 MB cc8d3a0c download
model.safetensors.index.json 263 KB 6e067ef4 download
config.json 35.7 KB bd6603b6 download
chat_template.jinja 15.9 KB 2a89f40c download
config-trained.json 4.84 KB 923b5e94 download
tokenizer_config.json 2.63 KB 872a4ded download
.gitattributes 1.53 KB 52373fe2 download
README.md 930 B 083ebfe0 download
processor_config.json 902 B 13e92a44 download

README current version from Hugging Face


license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: any-to-any
base_model: DavidAU/gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking
tags:

  • nightmedia
  • gemma4
  • gemma
  • google
  • mxfp8
  • mlx

gemma-4-E4B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-mxfp8-mlx

Brainwaves

         arc   arc/e boolq hswag obkqa piqa  wino
mxfp8    0.516,0.709,0.794,0.649,0.416,0.760,0.639

Perplexity
mxfp8    8.836 ± 0.091
mxfp4    9.980 ± 0.108

Baseline model

gemma-4-E4B-it
         arc   arc/e boolq hswag obkqa piqa  wino
mxfp8    0.480,0.656,0.797,0.608,0.400,0.755,0.665
mxfp4    0.455,0.607,0.851,0.585,0.402,0.744,0.651

Quant    Perplexity      Peak Memory   Tokens/sec
mxfp8    35.937 ± 0.525  14.80 GB      1153
mxfp4    36.746 ± 0.534  11.06 GB      1030

See parent model for instructions on install and use with Transformers.

-G

README history 9 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-04-13Update README.md42512b0930 B
    Loading...
  2. 2026-04-10Update README.md7ccc6c31.1 KB
    Loading...
  3. 2026-04-08Update README.md20a0882981 B
    Loading...
  4. 2026-04-07Update README.md7c5a840989 B
    Loading...
  5. 2026-04-07Update README.mdcb9aedb1013 B
    Loading...
  6. 2026-04-07Update README.md179a039670 B
    Loading...
  7. 2026-04-07Update README.md194b4dc426 B
    Loading...
  8. 2026-04-07Update README.md1369957328 B
    Loading...
  9. 2026-04-07Add files using upload-large-folder tool453d2a8565 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration