Get the app
← back to catalog · registered 2026-08-22 13:56

girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist

girishgupta Pythia second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/girishgupta%2Fdeep-ignorance-unfiltered_unlearned_wt_dist"
Response includes
  • classification unknown
  • files 8
  • author_summary 12 models
  • readme_text full
Try next
GET/models?author=girishgupta
All 12 models by girishgupta
 GET/models?family=pythia&method=unknown
Sibling pythia models · same method
 GET/methods/unknown
What "unknown" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
?
Primary method

Unclassified

No clear signals of an abliteration technique in this model.
Confidence
UNKNOWN
Why this label 1 signal
No classification signals present. This may not be an abliterated model at all - it could be a repackaging, a merge with unrelated goals, or unrelated content that mentions the term.
  • no classification signals present (no abliterated, uncensored, or known producer/method markers)
How we label → About ? →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
9
↑ 407% in 90 days
Likes
0
Model age
7mo ago
created 2026-03-11
Downloads over time
Now71→from14↑407%
1133557714 on Mar 1171 on Oct 1171 on Oct 6MarAprMayJunJulAugSepOct
Mar 11 → Oct 11 · 70 snapshots · spans 214 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

EleutherAI/deep-ignorance-unfiltered↓ 2,705 this lineage
girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist↓ 9

Metadata

Tags
safetensors gpt_neox unlearning arxiv:2505.22310 base_model:EleutherAI/deep-ignorance-unfiltered base_model:finetune:EleutherAI/deep-ignorance-unfiltered region:us

Related

Other by girishgupta
deep-ignorance-unfiltered_unlearned_npo 15 deep-ignorance-unfiltered_unlearned_ga_simple 12 deep-ignorance-unfiltered_unlearned_lat 12 deep-ignorance-unfiltered_unlearned_simnpo 12 deep-ignorance-unfiltered_unlearned_dpo 11
Same base model
mradermacher/deep-ignorance-unfiltered-GGUF 538 girishgupta/deep-ignorance-unfiltered_unlearned_npo 15 girishgupta/deep-ignorance-unfiltered_unlearned_ga_simple 12 girishgupta/deep-ignorance-unfiltered_unlearned_lat 12 girishgupta/deep-ignorance-unfiltered_unlearned_simnpo 12
Total size
12.8 GB
Files
8
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-03-21 20:31
Source huggingface.co/girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist ↗ Base model EleutherAI/deep-ignorance-unfiltered →

Files by quantization

Auxiliary files 8 files 12.8 GB
model.safetensors 12.8 GB 3703dd89 download
tokenizer.json 3.40 MB 3c4df68c download
README.md 9.13 KB e9fc338e download
.gitattributes 1.48 KB a6344aac download
config.json 846 B 997b64ee download
training_config.yaml 505 B fdec2600 download
tokenizer_config.json 392 B 0392dd61 download
generation_config.json 110 B 5a88d375 download

README current version from Hugging Face

tags:

  • unlearning
    base_model: EleutherAI/deep-ignorance-unfiltered

deep-ignorance-unfiltered_unlearned_wt_dist

This model was created by fine-tuning EleutherAI/deep-ignorance-unfiltered using the Weight Distortion unlearning algorithm. The method is based on Siddiqui et al. 2025. The goal of unlearning is to remove specific knowledge from a pretrained language model while preserving its general capabilities.

Hyperparameters

Parameter Value
Base model EleutherAI/deep-ignorance-unfiltered
Unlearning method Weight Distortion
Learning rate 3e-05
Epochs 3
Batch size 32
Max sequence length 2048
Optimizer adamw
Gradient clipping 1.0
Gradient accumulation steps 1
Seed 42
W&B / run name wt_dist__ep3_lr3e-05_bs32_wn0.01_mle2048_mli1024
Noise std 0.01

Evaluation Results

Benchmark Value
mmlu / acc 0.3310
mmlu / acc_stderr 0.0039
mmlu_abstract_algebra / acc 0.3100
mmlu_abstract_algebra / acc_stderr 0.0465
mmlu_anatomy / acc 0.4148
mmlu_anatomy / acc_stderr 0.0426
mmlu_astronomy / acc 0.3684
mmlu_astronomy / acc_stderr 0.0393
mmlu_business_ethics / acc 0.3300
mmlu_business_ethics / acc_stderr 0.0473
mmlu_clinical_knowledge / acc 0.3283
mmlu_clinical_knowledge / acc_stderr 0.0289
mmlu_college_biology / acc 0.3472
mmlu_college_biology / acc_stderr 0.0398
mmlu_college_chemistry / acc 0.2400
mmlu_college_chemistry / acc_stderr 0.0429
mmlu_college_computer_science / acc 0.2900
mmlu_college_computer_science / acc_stderr 0.0456
mmlu_college_mathematics / acc 0.2400
mmlu_college_mathematics / acc_stderr 0.0429
mmlu_college_medicine / acc 0.3064
mmlu_college_medicine / acc_stderr 0.0351
mmlu_college_physics / acc 0.2059
mmlu_college_physics / acc_stderr 0.0402
mmlu_computer_security / acc 0.4900
mmlu_computer_security / acc_stderr 0.0502
mmlu_conceptual_physics / acc 0.2511
mmlu_conceptual_physics / acc_stderr 0.0283
mmlu_econometrics / acc 0.2193
mmlu_econometrics / acc_stderr 0.0389
mmlu_electrical_engineering / acc 0.3448
mmlu_electrical_engineering / acc_stderr 0.0396
mmlu_elementary_mathematics / acc 0.2646
mmlu_elementary_mathematics / acc_stderr 0.0227
mmlu_formal_logic / acc 0.1746
mmlu_formal_logic / acc_stderr 0.0340
mmlu_global_facts / acc 0.3500
mmlu_global_facts / acc_stderr 0.0479
mmlu_high_school_biology / acc 0.3419
mmlu_high_school_biology / acc_stderr 0.0270
mmlu_high_school_chemistry / acc 0.2709
mmlu_high_school_chemistry / acc_stderr 0.0313
mmlu_high_school_computer_science / acc 0.3900
mmlu_high_school_computer_science / acc_stderr 0.0490
mmlu_high_school_european_history / acc 0.3455
mmlu_high_school_european_history / acc_stderr 0.0371
mmlu_high_school_geography / acc 0.3384
mmlu_high_school_geography / acc_stderr 0.0337
mmlu_high_school_government_and_politics / acc 0.3886
mmlu_high_school_government_and_politics / acc_stderr 0.0352
mmlu_high_school_macroeconomics / acc 0.2462
mmlu_high_school_macroeconomics / acc_stderr 0.0218
mmlu_high_school_mathematics / acc 0.2556
mmlu_high_school_mathematics / acc_stderr 0.0266
mmlu_high_school_microeconomics / acc 0.2437
mmlu_high_school_microeconomics / acc_stderr 0.0279
mmlu_high_school_physics / acc 0.2649
mmlu_high_school_physics / acc_stderr 0.0360
mmlu_high_school_psychology / acc 0.3963
mmlu_high_school_psychology / acc_stderr 0.0210
mmlu_high_school_statistics / acc 0.2454
mmlu_high_school_statistics / acc_stderr 0.0293
mmlu_high_school_us_history / acc 0.3284
mmlu_high_school_us_history / acc_stderr 0.0330
mmlu_high_school_world_history / acc 0.3544
mmlu_high_school_world_history / acc_stderr 0.0311
mmlu_human_aging / acc 0.3857
mmlu_human_aging / acc_stderr 0.0327
mmlu_human_sexuality / acc 0.4122
mmlu_human_sexuality / acc_stderr 0.0432
mmlu_humanities / acc 0.3216
mmlu_humanities / acc_stderr 0.0067
mmlu_international_law / acc 0.5207
mmlu_international_law / acc_stderr 0.0456
mmlu_jurisprudence / acc 0.3796
mmlu_jurisprudence / acc_stderr 0.0469
mmlu_logical_fallacies / acc 0.3620
mmlu_logical_fallacies / acc_stderr 0.0378
mmlu_machine_learning / acc 0.2679
mmlu_machine_learning / acc_stderr 0.0420
mmlu_management / acc 0.4272
mmlu_management / acc_stderr 0.0490
mmlu_marketing / acc 0.4274
mmlu_marketing / acc_stderr 0.0324
mmlu_medical_genetics / acc 0.3300
mmlu_medical_genetics / acc_stderr 0.0473
mmlu_miscellaneous / acc 0.4419
mmlu_miscellaneous / acc_stderr 0.0178
mmlu_moral_disputes / acc 0.3902
mmlu_moral_disputes / acc_stderr 0.0263
mmlu_moral_scenarios / acc 0.2380
mmlu_moral_scenarios / acc_stderr 0.0142
mmlu_nutrition / acc 0.3497
mmlu_nutrition / acc_stderr 0.0273
mmlu_other / acc 0.3614
mmlu_other / acc_stderr 0.0085
mmlu_philosophy / acc 0.4148
mmlu_philosophy / acc_stderr 0.0280
mmlu_prehistory / acc 0.3642
mmlu_prehistory / acc_stderr 0.0268
mmlu_professional_accounting / acc 0.2979
mmlu_professional_accounting / acc_stderr 0.0273
mmlu_professional_law / acc 0.2940
mmlu_professional_law / acc_stderr 0.0116
mmlu_professional_medicine / acc 0.2206
mmlu_professional_medicine / acc_stderr 0.0252
mmlu_professional_psychology / acc 0.3497
mmlu_professional_psychology / acc_stderr 0.0193
mmlu_public_relations / acc 0.3636
mmlu_public_relations / acc_stderr 0.0461
mmlu_security_studies / acc 0.2735
mmlu_security_studies / acc_stderr 0.0285
mmlu_social_sciences / acc 0.3481
mmlu_social_sciences / acc_stderr 0.0085
mmlu_sociology / acc 0.5274
mmlu_sociology / acc_stderr 0.0353
mmlu_stem / acc 0.2984
mmlu_stem / acc_stderr 0.0081
mmlu_us_foreign_policy / acc 0.5300
mmlu_us_foreign_policy / acc_stderr 0.0502
mmlu_virology / acc 0.3313
mmlu_virology / acc_stderr 0.0366
mmlu_world_religions / acc 0.4327
mmlu_world_religions / acc_stderr 0.0380
wikitext / bits_per_byte 0.7535
wikitext / bits_per_byte_stderr N/A
wikitext / byte_perplexity 1.6859
wikitext / byte_perplexity_stderr N/A
wikitext / word_perplexity 16.3301
wikitext / word_perplexity_stderr N/A
wmdp_bio_categorized_mcqa / acc 0.3786
wmdp_bio_categorized_mcqa / acc_stderr 0.0134
wmdp_bio_cloze_verified / acc_norm 0.3086
wmdp_bio_cloze_verified / acc_norm_stderr 0.0141
wmdp_bio_robust / acc 0.3249
wmdp_bio_robust / acc_stderr 0.0159
wmdp_bio_robust_bioweapons_and_bioterrorism / acc 0.2579
wmdp_bio_robust_bioweapons_and_bioterrorism / acc_stderr 0.0318
wmdp_bio_robust_dual_use_virology / acc 0.2857
wmdp_bio_robust_dual_use_virology / acc_stderr 0.0869
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc 0.3824
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc_stderr 0.0484
wmdp_bio_robust_expanding_access_to_threat_vectors / acc 0.3333
wmdp_bio_robust_expanding_access_to_threat_vectors / acc_stderr 0.1054
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc 0.3871
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc_stderr 0.0358
wmdp_bio_robust_rewritten / acc 0.2622
wmdp_bio_robust_rewritten / acc_stderr 0.0089
wmdp_bio_robust_rewritten_gibberish / acc 0.2602
wmdp_bio_robust_rewritten_gibberish / acc_stderr 0.0154
wmdp_bio_robust_rewritten_nonsensical_biology / acc 0.2602
wmdp_bio_robust_rewritten_nonsensical_biology / acc_stderr 0.0154
wmdp_bio_robust_rewritten_real_words_sciency / acc 0.2663
wmdp_bio_robust_rewritten_real_words_sciency / acc_stderr 0.0155
wmdp_bio_robust_viral_vector_research / acc 0.3138
wmdp_bio_robust_viral_vector_research / acc_stderr 0.0252
wmdp_bio_shortcut / acc 0.4938
wmdp_bio_shortcut / acc_stderr 0.0249
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc 0.4255
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc_stderr 0.0729
wmdp_bio_shortcut_dual_use_virology / acc 0.4211
wmdp_bio_shortcut_dual_use_virology / acc_stderr 0.1164
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc 0.4717
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc_stderr 0.0692
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc 0.6667
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc_stderr 0.1667
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc 0.5176
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc_stderr 0.0545
wmdp_bio_shortcut_viral_vector_research / acc 0.5052
wmdp_bio_shortcut_viral_vector_research / acc_stderr 0.0362

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-21Upload folder using huggingface_hubd3834769.1 KB
    Loading...
  2. 2026-03-11Upload folder using huggingface_hub045e597988 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration