Ablate just added

cais/wmdp-mmlu-auxiliary-corpora

published by @cais

Refusal-direction material, activation probes, steering and concept-erasure data.

size_categories:1K<n<10Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsarxiv:2403.03218 +1 more
Lifetime downloads
6.5K
Last 30 days
112
Likes
6
Size
3.2 MB

Description

Dataset Card for WMDP Auxiliary Corpora

This dataset includes the auxiliary corpora used to perform unlearning on the MMLU Auxiliary Benchmark task, from the WMDP paper.

See our paper, website, and GitHub for more details!

The corpora are also available at the following mirrors with password wmdpauxiliarycorpora: 1, 2

physics-corpus

Corpus comprising textbooks in high school and college physics.

law-corpus

Corpus comprising textbooks in… See the full description on the dataset page: https://huggingface.co/datasets/cais/wmdp-mmlu-auxiliary-corpora.

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Metadata

Created on HF
2024-03-05 · 2 years ago
Size category
1K<n<10K
Modalities
text
Formats
parquet
Libraries
datasetspandasmlcroissantpolars

Related datasets same stage · Ablate

Read further

Total size
3.2 MB
Files
5
Formats
parquet
Head
a4fab8f
Last updated on HF
2024-04-25

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("cais/wmdp-mmlu-auxiliary-corpora")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="cais/wmdp-mmlu-auxiliary-corpora", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/cais/wmdp-mmlu-auxiliary-corpora

Files by folder from our last crawl

top level 2 files 5.6 KB
.gitattributes 2.3 KB file download
README.md 3.3 KB md download
economics-corpus/ 1 file 2.0 MB
train-00000-of-00001.parquet 2.0 MB parquet download
law-corpus/ 1 file 578.6 KB
train-00000-of-00001.parquet 578.6 KB parquet download
physics-corpus/ 1 file 616.6 KB
train-00000-of-00001.parquet 616.6 KB parquet download

No README stored for this dataset yet.

Download from HuggingFace

cais/wmdp-mmlu-auxiliary-corpora

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration