Description
Dataset Card for WMDP Corpora
The Weapons of Mass Destruction Proxy (WMDP) Corpora includes all of the corpora used to perform unlearning on WMDP-Bio and WMDP-Cyber.
See our paper, website, and GitHub for more details!
The corpora are also available at the following mirrors with password wmdpcorpora: 1, 2
The bio forget corpus must be requested separately; please visit this form.
cyber-retain-corpus and cyber-forget-corpus
The forget and retain corpora… See the full description on the dataset page: https://huggingface.co/datasets/cais/wmdp-corpora.
Used by abliterated models
No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.
Metadata
Related datasets
Read further
Download the dataset
Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.
from datasets import load_dataset
ds = load_dataset("cais/wmdp-corpora") from huggingface_hub import snapshot_download
snapshot_download(repo_id="cais/wmdp-corpora", repo_type="dataset") git clone https://huggingface.co/datasets/cais/wmdp-corpora Files by folder
Showing the first 5,000 files. Full list on Hugging Face ↗
top level 3 files 293.2 KB
| .gitattributes | 2.3 KB | file | download |
| dataset.png | 287.1 KB | png | download |
| README.md | 3.8 KB | md | download |
bio-retain-corpus/ 4 files 883.6 MB
| train-00000-of-00004.parquet | 221.7 MB | parquet | download |
| train-00001-of-00004.parquet | 219.6 MB | parquet | download |
| train-00002-of-00004.parquet | 221.6 MB | parquet | download |
| train-00003-of-00004.parquet | 220.7 MB | parquet | download |
cyber-forget-corpus/ 1 file 10.8 MB
| train-00000-of-00001.parquet | 10.8 MB | parquet | download |
cyber-retain-corpus/ 1 file 26.4 MB
| train-00000-of-00001.parquet | 26.4 MB | parquet | download |
No file list for this dataset yet.
This repository is private or no longer exists on Hugging Face.
Open on Hugging Face ↗No README stored for this dataset yet.