Get the app
← back to catalog · registered 2026-08-22 13:56

girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist_reg

girishgupta Pythia second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/girishgupta%2Fdeep-ignorance-unfiltered_unlearned_wt_dist_reg"
Response includes
  • classification unknown
  • files 8
  • author_summary 12 models
  • readme_text full
Try next
GET/models?author=girishgupta
All 12 models by girishgupta
 GET/models?family=pythia&method=unknown
Sibling pythia models · same method
 GET/methods/unknown
What "unknown" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
?
Primary method

Unclassified

No clear signals of an abliteration technique in this model.
Confidence
UNKNOWN
Why this label 1 signal
No classification signals present. This may not be an abliterated model at all - it could be a repackaging, a merge with unrelated goals, or unrelated content that mentions the term.
  • no classification signals present (no abliterated, uncensored, or known producer/method markers)
How we label → About ? →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
10
↑ 113% in 90 days
Likes
0
Model age
6mo ago
created 2026-03-21
Downloads over time
Now68→from32↑113%
3044587232 on Mar 2568 on Oct 1168 on Oct 8MarAprMayJunJulAugSepOct
Mar 25 → Oct 11 · 68 snapshots · spans 200 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

EleutherAI/deep-ignorance-unfiltered↓ 2,705 this lineage
girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist_reg↓ 10

Metadata

Tags
safetensors gpt_neox unlearning arxiv:2505.22310 base_model:EleutherAI/deep-ignorance-unfiltered base_model:finetune:EleutherAI/deep-ignorance-unfiltered region:us

Related

Other by girishgupta
deep-ignorance-unfiltered_unlearned_npo 15 deep-ignorance-unfiltered_unlearned_ga_simple 12 deep-ignorance-unfiltered_unlearned_lat 12 deep-ignorance-unfiltered_unlearned_simnpo 12 deep-ignorance-unfiltered_unlearned_dpo 11
Same base model
mradermacher/deep-ignorance-unfiltered-GGUF 538 girishgupta/deep-ignorance-unfiltered_unlearned_npo 15 girishgupta/deep-ignorance-unfiltered_unlearned_ga_simple 12 girishgupta/deep-ignorance-unfiltered_unlearned_lat 12 girishgupta/deep-ignorance-unfiltered_unlearned_simnpo 12
Total size
12.8 GB
Files
8
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-03-21 21:05
Source huggingface.co/girishgupta/deep-ignorance-unfiltered_unlearned_wt_dist_reg ↗ Base model EleutherAI/deep-ignorance-unfiltered →

Files by quantization

Auxiliary files 8 files 12.8 GB
model.safetensors 12.8 GB 80071441 download
tokenizer.json 3.40 MB e4d4b99c download
README.md 9.18 KB 24c47284 download
.gitattributes 1.48 KB a6344aac download
config.json 846 B 997b64ee download
training_config.yaml 509 B b0457231 download
tokenizer_config.json 392 B 0392dd61 download
generation_config.json 110 B 5a88d375 download

README current version from Hugging Face

tags:

  • unlearning
    base_model: EleutherAI/deep-ignorance-unfiltered

deep-ignorance-unfiltered_unlearned_wt_dist_reg

This model was created by fine-tuning EleutherAI/deep-ignorance-unfiltered using the Weight Distortion (Regularized) unlearning algorithm. The method is based on Siddiqui et al. 2025. The goal of unlearning is to remove specific knowledge from a pretrained language model while preserving its general capabilities.

Hyperparameters

Parameter Value
Base model EleutherAI/deep-ignorance-unfiltered
Unlearning method Weight Distortion (Regularized)
Learning rate 3e-05
Epochs 3
Batch size 32
Max sequence length 512
Optimizer adamw
Gradient clipping 1.0
Gradient accumulation steps 1
Seed 42
W&B / run name wt_dist_reg__ep3_lr3e-05_bs32_wr1.0_mle512_mli10000
Regularizer lambda 1.0

Evaluation Results

Benchmark Value
mmlu / acc 0.2597
mmlu / acc_stderr 0.0037
mmlu_abstract_algebra / acc 0.1900
mmlu_abstract_algebra / acc_stderr 0.0394
mmlu_anatomy / acc 0.2074
mmlu_anatomy / acc_stderr 0.0350
mmlu_astronomy / acc 0.3289
mmlu_astronomy / acc_stderr 0.0382
mmlu_business_ethics / acc 0.2200
mmlu_business_ethics / acc_stderr 0.0416
mmlu_clinical_knowledge / acc 0.2906
mmlu_clinical_knowledge / acc_stderr 0.0279
mmlu_college_biology / acc 0.2500
mmlu_college_biology / acc_stderr 0.0362
mmlu_college_chemistry / acc 0.3700
mmlu_college_chemistry / acc_stderr 0.0485
mmlu_college_computer_science / acc 0.3000
mmlu_college_computer_science / acc_stderr 0.0461
mmlu_college_mathematics / acc 0.2200
mmlu_college_mathematics / acc_stderr 0.0416
mmlu_college_medicine / acc 0.3295
mmlu_college_medicine / acc_stderr 0.0358
mmlu_college_physics / acc 0.2745
mmlu_college_physics / acc_stderr 0.0444
mmlu_computer_security / acc 0.2200
mmlu_computer_security / acc_stderr 0.0416
mmlu_conceptual_physics / acc 0.2000
mmlu_conceptual_physics / acc_stderr 0.0261
mmlu_econometrics / acc 0.2281
mmlu_econometrics / acc_stderr 0.0395
mmlu_electrical_engineering / acc 0.2897
mmlu_electrical_engineering / acc_stderr 0.0378
mmlu_elementary_mathematics / acc 0.2407
mmlu_elementary_mathematics / acc_stderr 0.0220
mmlu_formal_logic / acc 0.3889
mmlu_formal_logic / acc_stderr 0.0436
mmlu_global_facts / acc 0.2000
mmlu_global_facts / acc_stderr 0.0402
mmlu_high_school_biology / acc 0.2806
mmlu_high_school_biology / acc_stderr 0.0256
mmlu_high_school_chemistry / acc 0.2906
mmlu_high_school_chemistry / acc_stderr 0.0319
mmlu_high_school_computer_science / acc 0.2500
mmlu_high_school_computer_science / acc_stderr 0.0435
mmlu_high_school_european_history / acc 0.2485
mmlu_high_school_european_history / acc_stderr 0.0337
mmlu_high_school_geography / acc 0.2374
mmlu_high_school_geography / acc_stderr 0.0303
mmlu_high_school_government_and_politics / acc 0.3368
mmlu_high_school_government_and_politics / acc_stderr 0.0341
mmlu_high_school_macroeconomics / acc 0.2974
mmlu_high_school_macroeconomics / acc_stderr 0.0232
mmlu_high_school_mathematics / acc 0.2370
mmlu_high_school_mathematics / acc_stderr 0.0259
mmlu_high_school_microeconomics / acc 0.2437
mmlu_high_school_microeconomics / acc_stderr 0.0279
mmlu_high_school_physics / acc 0.2583
mmlu_high_school_physics / acc_stderr 0.0357
mmlu_high_school_psychology / acc 0.3431
mmlu_high_school_psychology / acc_stderr 0.0204
mmlu_high_school_statistics / acc 0.3380
mmlu_high_school_statistics / acc_stderr 0.0323
mmlu_high_school_us_history / acc 0.2990
mmlu_high_school_us_history / acc_stderr 0.0321
mmlu_high_school_world_history / acc 0.2068
mmlu_high_school_world_history / acc_stderr 0.0264
mmlu_human_aging / acc 0.1031
mmlu_human_aging / acc_stderr 0.0204
mmlu_human_sexuality / acc 0.2824
mmlu_human_sexuality / acc_stderr 0.0395
mmlu_humanities / acc 0.2508
mmlu_humanities / acc_stderr 0.0063
mmlu_international_law / acc 0.1488
mmlu_international_law / acc_stderr 0.0325
mmlu_jurisprudence / acc 0.2593
mmlu_jurisprudence / acc_stderr 0.0424
mmlu_logical_fallacies / acc 0.2209
mmlu_logical_fallacies / acc_stderr 0.0326
mmlu_machine_learning / acc 0.2232
mmlu_machine_learning / acc_stderr 0.0395
mmlu_management / acc 0.3495
mmlu_management / acc_stderr 0.0472
mmlu_marketing / acc 0.2521
mmlu_marketing / acc_stderr 0.0284
mmlu_medical_genetics / acc 0.2700
mmlu_medical_genetics / acc_stderr 0.0446
mmlu_miscellaneous / acc 0.2299
mmlu_miscellaneous / acc_stderr 0.0150
mmlu_moral_disputes / acc 0.2312
mmlu_moral_disputes / acc_stderr 0.0227
mmlu_moral_scenarios / acc 0.2737
mmlu_moral_scenarios / acc_stderr 0.0149
mmlu_nutrition / acc 0.2810
mmlu_nutrition / acc_stderr 0.0257
mmlu_other / acc 0.2559
mmlu_other / acc_stderr 0.0077
mmlu_philosophy / acc 0.2444
mmlu_philosophy / acc_stderr 0.0244
mmlu_prehistory / acc 0.2037
mmlu_prehistory / acc_stderr 0.0224
mmlu_professional_accounting / acc 0.2199
mmlu_professional_accounting / acc_stderr 0.0247
mmlu_professional_law / acc 0.2555
mmlu_professional_law / acc_stderr 0.0111
mmlu_professional_medicine / acc 0.4007
mmlu_professional_medicine / acc_stderr 0.0298
mmlu_professional_psychology / acc 0.2222
mmlu_professional_psychology / acc_stderr 0.0168
mmlu_public_relations / acc 0.2364
mmlu_public_relations / acc_stderr 0.0407
mmlu_security_studies / acc 0.3102
mmlu_security_studies / acc_stderr 0.0296
mmlu_social_sciences / acc 0.2756
mmlu_social_sciences / acc_stderr 0.0080
mmlu_sociology / acc 0.2338
mmlu_sociology / acc_stderr 0.0299
mmlu_stem / acc 0.2613
mmlu_stem / acc_stderr 0.0078
mmlu_us_foreign_policy / acc 0.2700
mmlu_us_foreign_policy / acc_stderr 0.0446
mmlu_virology / acc 0.2229
mmlu_virology / acc_stderr 0.0324
mmlu_world_religions / acc 0.2281
mmlu_world_religions / acc_stderr 0.0322
wikitext / bits_per_byte 1.7813
wikitext / bits_per_byte_stderr N/A
wikitext / byte_perplexity 3.4373
wikitext / byte_perplexity_stderr N/A
wikitext / word_perplexity 736.9357
wikitext / word_perplexity_stderr N/A
wmdp_bio_categorized_mcqa / acc 0.2270
wmdp_bio_categorized_mcqa / acc_stderr 0.0118
wmdp_bio_cloze_verified / acc_norm 0.2184
wmdp_bio_cloze_verified / acc_norm_stderr 0.0126
wmdp_bio_robust / acc 0.2350
wmdp_bio_robust / acc_stderr 0.0144
wmdp_bio_robust_bioweapons_and_bioterrorism / acc 0.2368
wmdp_bio_robust_bioweapons_and_bioterrorism / acc_stderr 0.0309
wmdp_bio_robust_dual_use_virology / acc 0.2500
wmdp_bio_robust_dual_use_virology / acc_stderr 0.0833
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc 0.2353
wmdp_bio_robust_enhanced_potential_pandemic_pathogens / acc_stderr 0.0422
wmdp_bio_robust_expanding_access_to_threat_vectors / acc 0.1905
wmdp_bio_robust_expanding_access_to_threat_vectors / acc_stderr 0.0878
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc 0.1882
wmdp_bio_robust_reverse_genetics_and_easy_editing / acc_stderr 0.0287
wmdp_bio_robust_rewritten / acc 0.2351
wmdp_bio_robust_rewritten / acc_stderr 0.0086
wmdp_bio_robust_rewritten_gibberish / acc 0.2256
wmdp_bio_robust_rewritten_gibberish / acc_stderr 0.0147
wmdp_bio_robust_rewritten_nonsensical_biology / acc 0.2232
wmdp_bio_robust_rewritten_nonsensical_biology / acc_stderr 0.0146
wmdp_bio_robust_rewritten_real_words_sciency / acc 0.2565
wmdp_bio_robust_rewritten_real_words_sciency / acc_stderr 0.0153
wmdp_bio_robust_viral_vector_research / acc 0.2610
wmdp_bio_robust_viral_vector_research / acc_stderr 0.0238
wmdp_bio_shortcut / acc 0.2099
wmdp_bio_shortcut / acc_stderr 0.0204
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc 0.2128
wmdp_bio_shortcut_bioweapons_and_bioterrorism / acc_stderr 0.0603
wmdp_bio_shortcut_dual_use_virology / acc 0.2105
wmdp_bio_shortcut_dual_use_virology / acc_stderr 0.0961
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc 0.1887
wmdp_bio_shortcut_enhanced_potential_pandemic_pathogens / acc_stderr 0.0543
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc 0.1111
wmdp_bio_shortcut_expanding_access_to_threat_vectors / acc_stderr 0.1111
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc 0.2471
wmdp_bio_shortcut_reverse_genetics_and_easy_editing / acc_stderr 0.0471
wmdp_bio_shortcut_viral_vector_research / acc 0.2031
wmdp_bio_shortcut_viral_vector_research / acc_stderr 0.0291

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-21Upload folder using huggingface_hub7bc419d9.2 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration