← back to catalog · registered 2026-11-14 14:03

balllvin/Dory1.0-4B-abliterated-NVFP4

balllvin Nemotron 4B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/balllvin%2FDory1.0-4B-abliterated-NVFP4"
Response includes
  • classification m1
  • files 15
  • author_summary 28 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
46
↑ 1,050% in 90 days
Likes
0
Model age
1w ago
created 2026-11-13
Downloads over time
Now 46 → from 4 ↑ 1,050%
2183450 4 on Nov 14 46 on Nov 22 46 on Nov 20 Nov
Nov 14 → Nov 22 · 9 snapshots · spans 8 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 93 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Languages
en
Tags
transformers safetensors dory text-generation nvfp4 4-bit abliterated conversational en base_model:nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-NVFP4 base_model:finetune:nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-NVFP4 license:other

Related

Total size
2.98 GB
Files
15
Quantizations
1
Registered
2026-11-14 14:03
Last updated on HF
2026-11-18 13:48

Files by quantization

Auxiliary files 15 files 3.00 GB
model.safetensors 2.98 GB 8e3e98b5 download
tokenizer.json 16.3 MB 623c3456 download
tokenizer_config.json 173 KB c96e5ad0 download
nvfp4_build.json 11.5 KB dac5b03b download
chat_template.jinja 9.91 KB 7afbeb75 download
README.md 4.56 KB 023efca0 download
config.json 2.69 KB 3efc165b download
LICENSE.OpenMDW-1.1 2.56 KB ec297ac5 download
ablit_bench.json 1.56 KB 40b2233b download
.gitattributes 1.53 KB 52373fe2 download
chunk_eval.json 966 B 4bb3e217 download
NOTICE.md 796 B 80c5b8a4 download
special_tokens_map.json 563 B 0451f379 download
hf_quant_config.json 260 B 7ceadee6 download
generation_config.json 225 B 2404c059 download

README current version from Hugging Face


library_name: transformers
license: other
license_name: openmdw-1.1
license_link: https://openmdw.ai/license/1-1/
pipeline_tag: text-generation
base_model: nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-NVFP4
language:

  • en
    tags:
  • nvfp4
  • 4-bit
  • dory
  • abliterated

Dory 1.0 4B abliterated NVFP4

NVIDIA's Nemotron-Labs Dory 1.0 4B in NVFP4, with its refusal direction removed. It refuses far fewer harmful
prompts than NVIDIA's NVFP4 build and keeps its MMLU score. It is for research. See Limits.

Apple silicon twin (same 4-bit codes, MLX layout):
balllvin/Dory1.0-4B-abliterated-NVFP4-MLX.
Trained on top of this build with Nous Research's Arete values data:
balllvin/Dory1.0-4B-abliterated-Arete-NVFP4.

Results

Measured on one NVIDIA RTX PRO 6000 with vLLM, thinking on, temperature 1.0, top-p 0.95, up to 16,384 new tokens,
one sample per prompt. Refusals are judged on the final answer with OBLITERATUS's rule-based phrase lists.
JailbreakBench (JBB-Behaviors) is a sealed set here: 99 harmful and 100 benign prompts, never used to build the model.

Build Loops Harmful refused Benign refused MMLU (300)
NVIDIA NVFP4 2 56 of 99, 56.6% (95% CI 46.7 to 65.9) 17 of 100, 17.0% 0.830 (0.783 to 0.868)
This model 2 13 of 99, 13.1% (7.8 to 21.2) 0 of 98 finished, 0.0% 0.857 (0.812 to 0.892)
NVIDIA NVFP4 4 54 of 99, 54.5% 19% 0.840
This model 4 23 of 99, 23.2% 0 of 99 0.837

Median answer length at 2 loops (completion tokens): harmful 695, benign 3,667 (NVIDIA NVFP4: 453 and 2,604).

Censorship and Propaganda Eval (Nous Research, 803 prompts, card profile, Grok judge, 4 loops): fact score 1.993
(95% CI 1.850 to 2.133) against 1.823 (1.679 to 1.966) for NVIDIA's NVFP4; any propaganda 1.49% against 0.62%.
Outputs: balllvin/Propaganda-Eval-Dory-Abliterated-NVFP4.

How it was made

  1. Direction. A refusal direction was found with the OBLITERATUS method on harmful and harmless prompt sets and
    projected out of every residual writer (o_proj, down_proj and the embedding) of the official bf16 model, in
    memory only.
  2. NVFP4 build. The NVIDIA NVFP4 file was the student: NVIDIA's frozen block and tensor scales, fp32 latent
    weights, codes re-rounded every step. It was trained by quantization aware distillation (KL to the edited bf16
    teacher, thinking on, 4 loops, 17 steps, learning rate 1e-5) on the edited teacher's own answers to prompts from
    public NVIDIA sets (Nemotron-Science-v1, Nemotron-Agentic-v1, Nemotron-SpecializedDomains-Finance-v1,
    Daring-Anteater, Nemotron-SFT-CUDA-v1; CC BY 4.0) and FineWeb-Edu text (ODC-BY).
  3. The training ran to completion: 3 passes over 1,194 self-generated answers (2.68M tokens, 17 steps).
  4. Only NVFP4 weights were exported. The weight scales are NVIDIA's own, unchanged (all 288 weight_scale_2
    values equal the official file, so vLLM's fused q/k/v and gate/up layers see one scale each). There is no bf16
    version of this model.

Use

NVFP4 only (W4A16, ModelOpt layout, the same as NVIDIA's NVFP4 file). Thinking is on. Dory is a looped model: use
2 loops by default and 4 for hard tasks.

vllm serve balllvin/Dory1.0-4B-abliterated-NVFP4 --served-model-name dory \
  --hf-overrides '{"n_recurrent_loops": 2}' --reasoning-parser nemotron_v3 --max-model-len 40960

Sampling as on NVIDIA's card: temperature 1.0, top-p 0.95. The model reasons first; a short max_tokens returns
empty content. vLLM needs a build with DoryForCausalLM (vLLM main after Dory support landed).

Limits

  • The model is abliterated. It answers many harmful requests. It is not safe for unsupervised or user-facing use.
  • Quality was measured as refusal rates and a 300-question MMLU slice only. No GPQA, coding or finance run is reported
    here.
  • Each number is one run with sampling, on one stack.

Credits

  • NVIDIA, for Nemotron-Labs Dory 1.0 4B and its NVFP4 release (OpenMDW 1.1).
  • OBLITERATUS, for the abliteration method (AGPL-3.0; no OBLITERATUS code is in this repo).
  • JailbreakBench (JBB-Behaviors) and MMLU, for the measurement sets.

Licence

Weights, config and tokenizer: OpenMDW 1.1, the licence of the NVIDIA base. The
full text is in LICENSE.OpenMDW-1.1 and the origin is in NOTICE.md.

This is an independent community build. It is not an NVIDIA product and NVIDIA has not reviewed or endorsed it.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration