Alignment datasets by RLHFlow

Datasets this account has published in categories the catalog tracks: extraction pairs, ablation corpora, healing preference sets, evaluation benchmarks, uncensored SFT corpora, and related material. Category badges link to the workflow stage.

3 in /datasets
Dataset
Stage
Downloads
HH-RLHF-Helpful-standard 0 0
We process the helpful subset of Anthropic-HH into the standard format. The filtering script is as follows. def filter_example(example): ...
25.5k
HH-RLHF-Harmless-and-RedTeam-standard 0 0
We process the Harmlnessess and Red-Teaming subsets of Anthropic-HH into the standard format. The filtering script is as follows. def filte...
20.7k
Orca-distibalel-standard 0 0
From argilla/distilabel-intel-orca-dpo-pairs. We delete the pairs with the same score. def process_example(example): prompt = example['i...
16.8k
Dataset
Stage
Downloads
HH-RLHF-Harmless-and-RedTeam-standard 0 0
We process the Harmlnessess and Red-Teaming subsets of Anthropic-HH into the standard format. The filtering script is as follows. def filte...
20.7k
Orca-distibalel-standard 0 0
From argilla/distilabel-intel-orca-dpo-pairs. We delete the pairs with the same score. def process_example(example): prompt = example['i...
16.8k
HH-RLHF-Helpful-standard 0 0
We process the helpful subset of Anthropic-HH into the standard format. The filtering script is as follows. def filter_example(example): ...
25.5k
Dataset
Stage
Downloads
HH-RLHF-Helpful-standard 0 0
We process the helpful subset of Anthropic-HH into the standard format. The filtering script is as follows. def filter_example(example): ...
25.5k
HH-RLHF-Harmless-and-RedTeam-standard 0 0
We process the Harmlnessess and Red-Teaming subsets of Anthropic-HH into the standard format. The filtering script is as follows. def filte...
20.7k
Orca-distibalel-standard 0 0
From argilla/distilabel-intel-orca-dpo-pairs. We delete the pairs with the same score. def process_example(example): prompt = example['i...
16.8k
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration