Alignment datasets by ethz-spylab

Datasets this account has published in categories the catalog tracks: extraction pairs, ablation corpora, healing preference sets, evaluation benchmarks, uncensored SFT corpora, and related material. Category badges link to the workflow stage.

7 in /datasets
Dataset
Stage
Downloads
rlhf_trojan_dataset 0 0
Dataset for the competition This is the official dataset for the competition "Find the Trojan: Universal Backdoor Detection in Aligned LL...
26.2k
curated-harmless-dataset 0 0
This dataset contains manually crafted pairs of comparison to address reward hacking in RLHF optimization. Examples of rejected behavior are...
2.4k
EvilMath 0 0
Mathematical problems on harmful topics generated from GSM8K. EvilMath contains harmful questions with objectively verifiable ground truth a...
1.5k
competition_eval_dataset 0 0
Evaluation dataset for the Trojan Competition This dataset was used to evaluate submissions to the RLHF Trojan Detection competition co-l...
1.3k
hh-harmless-train-with-rewards 0 0
This dataset is an instance from the harmless-base split from the Anthropic/hh-rlhf dataset. All entries have been assigned a reward with ou...
1.1k
harmless-eval-SUDO 0 0
Dataset Card for "harmless-eval-SUDO" More Information needed
1k
harmless-poisoned-10-SUDO 0 0
Dataset Card for "harmless-poisoned-10-SUDO" More Information needed
612
Dataset
Stage
Downloads
EvilMath 0 0
Mathematical problems on harmful topics generated from GSM8K. EvilMath contains harmful questions with objectively verifiable ground truth a...
1.5k
rlhf_trojan_dataset 0 0
Dataset for the competition This is the official dataset for the competition "Find the Trojan: Universal Backdoor Detection in Aligned LL...
26.2k
harmless-eval-SUDO 0 0
Dataset Card for "harmless-eval-SUDO" More Information needed
1k
harmless-poisoned-10-SUDO 0 0
Dataset Card for "harmless-poisoned-10-SUDO" More Information needed
612
competition_eval_dataset 0 0
Evaluation dataset for the Trojan Competition This dataset was used to evaluate submissions to the RLHF Trojan Detection competition co-l...
1.3k
curated-harmless-dataset 0 0
This dataset contains manually crafted pairs of comparison to address reward hacking in RLHF optimization. Examples of rejected behavior are...
2.4k
hh-harmless-train-with-rewards 0 0
This dataset is an instance from the harmless-base split from the Anthropic/hh-rlhf dataset. All entries have been assigned a reward with ou...
1.1k
Dataset
Stage
Downloads
rlhf_trojan_dataset 0 0
Dataset for the competition This is the official dataset for the competition "Find the Trojan: Universal Backdoor Detection in Aligned LL...
26.2k
competition_eval_dataset 0 0
Evaluation dataset for the Trojan Competition This dataset was used to evaluate submissions to the RLHF Trojan Detection competition co-l...
1.3k
harmless-poisoned-10-SUDO 0 0
Dataset Card for "harmless-poisoned-10-SUDO" More Information needed
612
curated-harmless-dataset 0 0
This dataset contains manually crafted pairs of comparison to address reward hacking in RLHF optimization. Examples of rejected behavior are...
2.4k
EvilMath 0 0
Mathematical problems on harmful topics generated from GSM8K. EvilMath contains harmful questions with objectively verifiable ground truth a...
1.5k
hh-harmless-train-with-rewards 0 0
This dataset is an instance from the harmless-base split from the Anthropic/hh-rlhf dataset. All entries have been assigned a reward with ou...
1.1k
harmless-eval-SUDO 0 0
Dataset Card for "harmless-eval-SUDO" More Information needed
1k
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration