← back to catalog · registered 2026-11-14 14:03

balllvin/Dory1.0-4B-abliterated-NVFP4-MLX

balllvin Nemotron 4B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/balllvin%2FDory1.0-4B-abliterated-NVFP4-MLX"
Response includes
  • classification m1
  • files 13
  • author_summary 28 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
47
Likes
0
Model age
1w ago
created 2026-11-13
Downloads over time
Now 47 → from 0 ↑ 0%
0173452 0 on Nov 14 47 on Nov 22 47 on Nov 16 Nov
Nov 14 → Nov 22 · 9 snapshots · spans 8 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 93 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Languages
en
Tags
mlx safetensors dory nvfp4 4-bit abliterated text-generation conversational en base_model:balllvin/Dory1.0-4B-abliterated-NVFP4 base_model:quantized:balllvin/Dory1.0-4B-abliterated-NVFP4 license:other

Related

Total size
2.98 GB
Files
13
Quantizations
1
Registered
2026-11-14 14:03
Last updated on HF
2026-11-18 13:48

Files by quantization

Auxiliary files 13 files 3.00 GB
model.safetensors 2.98 GB 31752f06 download
nvfp4_source.safetensors 830 KB b21698d3 download
tokenizer.json 16.3 MB 623c3456 download
tokenizer_config.json 173 KB c96e5ad0 download
chat_template.jinja 9.91 KB 7afbeb75 download
README.md 6.02 KB fd259b48 download
LICENSE.OpenMDW-1.1 2.56 KB ec297ac5 download
config.json 2.29 KB d81ca829 download
.gitattributes 1.53 KB 52373fe2 download
NOTICE.md 1.14 KB 90fff5b5 download
nvfp4_mlx.json 787 B c5758902 download
special_tokens_map.json 563 B 0451f379 download
generation_config.json 225 B 2404c059 download

README current version from Hugging Face


library_name: mlx
license: other
license_name: openmdw-1.1
license_link: https://openmdw.ai/license/1-1/
pipeline_tag: text-generation
base_model: nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-NVFP4
language:

  • en
    tags:
  • mlx
  • nvfp4
  • 4-bit
  • dory
  • abliterated

Dory 1.0 4B abliterated NVFP4 on MLX

The MLX build of the abliterated NVFP4 Dory 1.0 4B, for Apple silicon. It has the same 4-bit codes and block scales as
the NVFP4 build balllvin/Dory1.0-4B-abliterated-NVFP4,
laid out so MLX loads it directly. Use this repo on a Mac. Use the NVFP4 repo elsewhere.

The same model after Nous Research's Arete values training:
balllvin/Dory1.0-4B-abliterated-Arete-NVFP4 and its MLX twin
balllvin/Dory1.0-4B-abliterated-Arete-NVFP4-MLX.

This model refuses fewer requests than NVIDIA's original. It is for research. See Limits.

Abliteration

The refusal direction was removed with the OBLITERATUS method. It was projected out of every residual writer
(o_proj, down_proj and the embedding). Then the NVFP4 build was trained back toward its bf16 teacher with
quantization aware distillation (route R1: abliterate, then QAD; 17 steps, learning rate 1e-5).

Only NVFP4 is in this repo. Thinking is on, and the recommended loop count is 2 by default and 4 for hard tasks.

Results

Measure Result Stack and settings
Harmful prompts refused 13 of 99 (13.1%, 95% CI 7.8 to 21.2%) MLX build, 4 loops, thinking on, temperature 1.0, top-p 0.95, 16,384 new tokens
Harmless prompts refused 2 of 100 (2.0%, 95% CI 0.6 to 7.0%) Same
Median completion tokens 658 harmful, 4,367 harmless Same
Harmful prompts refused, NVFP4 build 23 of 99 (23.2%) vLLM, 4 loops, thinking on, lab run
Harmful prompts refused, NVIDIA NVFP4 54 of 99 (54.5%) Same
Harmless prompts refused, NVFP4 build 0 of 99 Same
Harmless prompts refused, NVIDIA NVFP4 19% Same
MMLU, 300 questions, NVFP4 build 0.837 (NVIDIA NVFP4: 0.840) vLLM, 4 loops, thinking on, lab run

The MLX and vLLM rows come from different stacks and sampling, so the refusal rates are not one like-for-like
measurement. The MLX run is a single run on the sealed prompt sets, which are not published. The MMLU row was
measured on vLLM only.

Not measured in this repo: GPQA Diamond, finance and coding tasks.

Run on a Mac

Install the same pinned MLX stack as the NVFP4 MLX build:

python3 -m venv venv && . venv/bin/activate
pip install "mlx==0.32.4" \
  "git+https://github.com/pmichalas/mlx-lm@208065f3354e8c2645b658493b6aeb94eb0aaa77" \
  sentencepiece protobuf
hf download balllvin/Dory1.0-4B-abliterated-NVFP4-MLX --local-dir dory-ablit-mlx
python dory-ablit-mlx/tools/serve.py --model dory-ablit-mlx --port 8097 --temp 1.0 --top-p 0.95

The plain server needs no tools/ folder:

python -m mlx_lm server --model dory-ablit-mlx --port 8097 --temp 1.0 --top-p 0.95

Both speak the OpenAI chat API:

curl http://127.0.0.1:8097/v1/chat/completions -H 'Content-Type: application/json' \
  -d '{"messages":[{"role":"user","content":"Hello"}],"max_tokens":2000}'

The model reasons before it answers, in the reasoning field. A simple question used 650 to 1,200 tokens, so a low
max_tokens returns empty content.

A load test on one Apple silicon Mac loaded the model with mlx_lm.load from the pinned fork and answered a chat prompt.

Check or rebuild the conversion

tools/ turns a W4A16_NVFP4 Dory folder into an MLX folder. It needs only NumPy and loads no weights into MLX.

python dory-ablit-mlx/tools/convert.py --source <NVFP4 folder> --out my-dory-mlx
python dory-ablit-mlx/tools/verify.py  --source <NVFP4 folder> --out my-dory-mlx

verify.py re-reads both folders and accounts for every byte. For this build it reported all 507 tensors, with
3,201,564,672 identical bytes, against the NVFP4 build. The 72 gate vectors are the only changed tensors.

How the conversion works

MLX reads NVFP4 codes and block scales through mx.quantized_matmul, in the byte layout the NVFP4 build stores. MLX has
no input for the tensor scale (weight_scale_2), so the converter handles it:

  • Same bytes: all 288 weight and 288 weight_scale tensors (fused by row and retyped), and 147 bf16 tensors.
  • Changed: 72 gate vectors (s_gate, suv_gate), stored in fp32 with their scale folded in.
  • nvfp4_source.safetensors keeps the 288 source scales and 72 source gate vectors.
  • nvfp4_mlx.json records the source folder, the model hash and the changed tensors.

Limits

  • The model is abliterated. On the Mac run it refused 13 of 99 harmful prompts, against 54.5% for NVIDIA's model on vLLM.
    It can produce harmful content. It is not safe for unsupervised or user-facing use.
  • Thinking is on. Replies are long, and short token limits return empty content.
  • Quality was measured as refusal rates, plus MMLU on vLLM only. No MLX MMLU, GPQA, finance or coding run is in this repo.
  • Only one Apple silicon Mac was tested.
  • Loading prints a tokenizer warning about fix_mistral_regex. The same warning appears in the NVFP4 MLX build; it has not been traced.
  • The converter handles W4A16_NVFP4 Dory folders with a single model.safetensors.

Credits

  • NVIDIA, for Nemotron-Labs Dory 1.0 4B (the base model, released under OpenMDW 1.1).
  • OBLITERATUS, for the abliteration method (AGPL-3.0; no OBLITERATUS code is included).
  • MLX (Apple), and the pinned mlx-lm fork by pmichalas, which adds Dory support.

Licence

  • Model weights, config and tokenizer: OpenMDW 1.1, the same licence as the NVIDIA
    base and the NVFP4 build. The full text is in LICENSE.OpenMDW-1.1 and the origin is in NOTICE.md.
  • Code in tools/: MIT, in tools/LICENSE.

This is an independent community build. It is not an NVIDIA product and NVIDIA has not reviewed or endorsed it.
"NVIDIA" and "Dory" name the source model only.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration