Get the app
STAGE 3 OF 6

Heal · dpo and orpo preference mixes to recover capability after ablation

The healing tier. Preference-pair datasets used in a DPO or ORPO pass after abliteration to recover benchmark drops. mlabonne/orpo-dpo-mix-40k is the reference; toxic-dpo-v0.2 and Intel/orca_dpo_pairs are common ingredients.

229
Datasets tracked
977.7k
Lifetime downloads
2.0k
Total likes
145
Publishers
14
New this month

Where this fits in the pipeline

Wiki index →
Practical how-to
Healing section covers when to run DPO and which mix to pick.
read →
Reading benchmarks
How to tell if healing actually recovered capability.
read →
DPO bypass caveat
Why DPO can hide but not remove a refusal that survived ablation.
read →
Community best practices (heal)
Four conventions on DPO mix choice and stopping criteria.
read →

Recipes · heal

from the community craft-knowledge survey

Post-ablation DPO/ORPO healing on the reference mix (NeuralDaredevil pattern)

Datasets
mlabonne/orpo-dpo-mix-40k mlabonne/orpo-dpo-mix-40k-flat (for DPO)
Tool
trl DPOTrainer or LazyAxolotl (rl: orpo)
Params
Light preference alignment: do not lobotomize. orpo_alpha = 0.1. chat_template = chatml (use type: chatml.intel with the -flat variant for DPO). Full 40k for production; 1000 samples for a demo pass.
Time
A few GPU-hours for a full pass on 8B. Labonne demonstrated 1000 samples for a fast iteration.
Expected
Recovers most of the capability drop from abliteration. GSM8K remains the laggard - the 40k mix is math-poor.
Failures
Over-training the DPO stage. The 40k mix contains toxic-dpo-v0.2 (desired for uncensoring, but documented as an artifact source). DPO bypasses rather than removes vectors: the capability persists dormant.
commands 
pip install trl datasets accelerate bitsandbytes
python -m trl dpo --model_name <abliterated-base> \
  --dataset_name mlabonne/orpo-dpo-mix-40k-flat \
  --learning_rate 5e-7 --num_train_epochs 1 --bf16
Source: mlabonne: uncensor any LLM with abliteration →

CHES-filtered DPO preference set to avoid likelihood-displacement unalignment

Datasets
Anthropic/hh-rlhf mlabonne/harmful_behaviors unalignment/toxic-dpo-v0.2 (optional)
Tool
Preference-set preprocessing plus trl DPO/ORPO
Params
Filter with the length-normalised CHES score, keeping the 5% of samples with the lowest scores (up to 15% works comparably). Ensure chosen and rejected are genuinely different response types, not two refusals or two compliances.
Time
Preprocessing is cheap. The training run dominates.
Expected
A preference set where preferred responses increase in log-probability during DPO, avoiding the pathology where mass shifts off the intended target.
Failures
Pairs with two same-type responses have high CHES scores and cause probability mass to move off the preferred refusal, an outcome documented as unintentional unalignment.
Source: Razin et al., Likelihood Displacement in DPO →

Reconstruct or customise the standard 40k healing mix from source datasets

Datasets
argilla/Capybara-Preferences argilla/distilabel-intel-orca-dpo-pairs argilla/ultrafeedback-binarized-preferences-cleaned argilla/distilabel-math-preference-dpo
Tool
HuggingFace datasets library plus rule-based filtering
Params
Capybara chosen score >= 5 (7,424). Orca-DPO chosen >= 9 excluding GSM8K (2,299). Ultrafeedback chosen >= 5 (22,799). Math preference chosen >= 9 (2,181). Optionally add toxic-dpo-v0.2. Rule-based gptism filter removes about 2,206. Total: 44,245.
Time
A few minutes of preprocessing.
Expected
A 40k ORPO/DPO mix identical in shape to mlabonne/orpo-dpo-mix-40k. Use dataset.filter to exclude toxic-dpo-v0.2 for a non-toxic variant.
Failures
Including toxic-dpo-v0.2 in a model meant to remain safe. The mix is light on math, so GSM8K under-recovers.
commands 
from datasets import load_dataset, concatenate_datasets
ds = load_dataset("mlabonne/orpo-dpo-mix-40k", split="train")
ds_safe = ds.filter(lambda x: x["source"] != "toxic-dpo-v0.2")
Source: mlabonne/orpo-dpo-mix-40k card →

Match the healing mix to the parent-model family (chat template + rl mode)

Datasets
mlabonne/orpo-dpo-mix-40k (ChatML via chat_template.argilla) Intel/orca_dpo_pairs argilla/dpo-mix-7k
Tool
Axolotl (rl: dpo or rl: orpo)
Params
orpo_alpha: 0.1. chat_template: chatml for the 40k ORPO mix. For DPO use type: chatml.intel with orpo-dpo-mix-40k-flat. Sizing convention 5k to 40k (Labonne used 1000 samples for a fast demo, full 40k for production). Gemma and Llama need their own chat templates, not ChatML.
Time
Proportional to sample count and model size. A 40k pass on 8B is a few GPU-hours.
Expected
Recovered instruction-following without re-censoring. GSM8K still lags because the mix is math-poor.
Failures
Template mismatch (Gemma and Llama use different chat templates than ChatML). DPO can bypass rather than remove toxic vectors: they remain dormant and reactivatable, so a "healed" model is not necessarily a safe one.
commands 
pip install axolotl
accelerate launch -m axolotl.cli.train qwen3_8b_orpo.yml
Source: mlabonne: ORPO with Llama 3 →

All heal datasets

001
argilla / distilabel-intel-orca-dpo-pairs 0 0 0 3
75.6 MB
185.3k
185
2.8y
002
arcee-ai / distilabel-intel-orca-dpo-pairs-binarized 0 0 0
29.5 MB
141.3k
1
2.4y
003
Intel / orca_dpo_pairs 0 0 0 5
34.6 MB
124.5k
332
3.1y
004
HuggingFaceH4 / orca_dpo_pairs 0 0 0 4
29.4 MB
73.3k
32
2.8y
005
argilla / dpo-mix-7k 0 0 0 5
23.1 MB
60.9k
181
2.7y
006
allenai / preference-test-sets 0 0 0 3
33.5 MB
58.0k
29
2.8y
007
llm-blender / Unified-Feedback 0 0 0 1
1.8 GB
57.5k
18
2.8y
008
mlabonne / orpo-dpo-mix-40k 0 0 0 7
120.6 MB
50.1k
314
2.5y
009
llamafactory / DPO-En-Zh-20k 0 0 0 1
76.2 MB
22.3k
106
2.5y
010
RLHFlow / Orca-distibalel-standard 0 0 0 1
11.9 MB
16.8k
1
2.5y
011
unalignment / toxic-dpo-v0.2 0 0 0 3
486 KB
14.3k
144
2.8y
012
mlabonne / chatml_dpo_pairs 0 0 0 2
18.6 MB
5.5k
55
2.9y
013
unalignment / toxic-dpo-v0.1 0 0 0 3
499 KB
5.4k
143
2.9y
014
multilingual / orca_dpo_pairs 0 0 0 2
112.0 MB
5.3k
20
2.6y
015
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs 0 0 0 2
15.1 MB
4.4k
4
2.8y
016
NobodyExistsOnTheInternet / ToxicDPOqa 0 0 0 3
75.0 MB
3.7k
20
2.8y
017
NeuralNovel / Neural-DPO 0 0 0 1
641 KB
3.4k
31
2.8y
018
mlabonne / orpo-dpo-mix-40k-flat 0 0 0 2
82.1 MB
3.4k
17
2.4y
019
shibing624 / DPO-En-Zh-20k-Preference 0 0 0 1
72.4 MB
3.3k
18
2.5y
020
BramVanroy / orca_dpo_pairs_dutch_cleaned 0 0 0 1
69.5 MB
3.1k
3
2.5y
021
Undi95 / toxic-dpo-v0.1-NoWarning 0 0 0 1
1.0 MB
3.0k
26
2.8y
022
tytodd / qwen3.5-2b-v2-instructions-smoke-10k-smoke-mnbt16k 0 0 0 1
314.0 MB
2.7k
0
6mo
023
dislove / calegal 0 0 0
6.9 MB
2.6k
0
5mo
024
kyujinpy / orca_math_dpo 0 0 0 2
20.9 MB
2.5k
20
2.8y
025
tytodd / qwen3.5-2b-v2-instructions-smoke-10k 0 0 0
390.2 MB
2.4k
0
6mo
026
malhajar / orca_dpo_pairs-tr 0 0 0 3
64.3 MB
2.4k
7
2.6y
027
yoonholee / combined-preference-dataset 0 0 0 1
1.1 GB
2.3k
1
2.3y
028
5CD-AI / Vietnamese-Intel-orca_dpo_pairs-gg-translated 0 0 0 2
80.8 MB
2.3k
36
2.8y
029
open-llm-leaderboard-old / details_glenn2__gemma-7b-lora-distilabel-intel-orca-dpo-pairs 0 0 0
85.6 MB
2.2k
0
2.7y
030
BramVanroy / orca_dpo_pairs_dutch 0 0 0 3
46.0 MB
2.0k
6
2.9y
031
adamo1139 / toxic-dpo-natural-v5 0 0 0 1
6.1 MB
1.9k
13
2.5y
032
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-12h 0 0 0
86.5 MB
1.9k
0
2.7y
033
SJ-Donald / orca-dpo-pairs-ko 0 0 0 1
50.4 MB
1.9k
10
2.7y
034
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-4h 0 0 0
86.4 MB
1.7k
0
2.7y
035
diffnamehard / toxic-dpo-v0.1-NoWarning-alpaca 0 0 0 1
670 KB
1.7k
4
2.8y
036
Undi95 / toxic-dpo-v0.1-sharegpt 0 0 0 1
1.4 MB
1.7k
18
2.8y
037
mncai / orca_dpo_pairs_ko 0 0 0 1
32.9 MB
1.6k
7
2.8y
038
open-llm-leaderboard-old / details_lvkaokao__mistral-7b-finetuned-orca-dpo-v2 0 0 0
133.1 MB
1.6k
0
2.9y
039
orangetin / orca-dpo-pairs-cleaned 0 0 0 1
27.2 MB
1.5k
1
2.8y
040
argilla / distilabel-intel-orca-kto 0 0 0 1
16.3 MB
1.5k
9
2.6y
041
when2rl / distilabel-intel-orca-dpo-pairs_cleaned_reformatted 0 0 0 3
70.6 MB
1.3k
0
2.6y
042
malhajar / distilabel-intel-orca-dpo-pairs-tr 0 0 0 1
180.4 MB
1.3k
6
2.6y
043
ariffazil / AAA 0 0 0 3
1.2 MB
1.3k
0
7mo
044
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo 0 0 0 1
40.4 MB
1.3k
2
2.7y
045
suayptalha / Turkish-DPO-Pairs 0 0 0 1
9.6 MB
1.3k
3
1.6y
046
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-8h 0 0 0
86.4 MB
1.2k
0
2.7y
047
NeuralNovel / Unsloth-DPO 0 0 0 2
31 KB
1.2k
7
2.7y
048
nthakur / multilingual-distilabel-intel-orca-dpo-pairs-v0.1 0 0 0
22.2 MB
1.1k
0
2.6y
049
Filippo / distilabel-intel-orca-dpo-pairs-filtered 0 0 0 2
35.2 MB
1.1k
0
2.7y
050
duxx / distilabel-intel-orca-dpo-pairs-tr 0 0 0 2
8.8 MB
1.1k
7
2.8y
051
Minami-su / toxic-sft-zh 0 0 0 1
86.3 MB
1.1k
32
2.4y
052
CorticalStack / tak-stack-dpo 0 0 0
16.1 MB
1.1k
1
2.6y
053
mlabonne / distilabel-intel-orca-dpo-pairs 0 0 0 2
35.0 MB
1.1k
3
2.7y
054
Orion-zhen / dpo-toxic-zh 0 0 0 1
6.1 MB
1.1k
22
2.2y
055
leafspark / toxic-dpo-v0.2-nfoa-bypass 0 0 0 2
485 KB
1.0k
2
2.4y
056
floleuerer / distilabel-intel-orca-dpo-pairs-binarized 0 0 0 3
13.1 MB
1.0k
0
2.8y
057
cho-ai / constitutional-mt-data 0 0 0
15.7 GB
1.0k
5
4mo
058
redsgnaoh / orcaratgen 0 0 0 1
20.4 MB
980
2
2.2y
059
Edgerunners / NobodyExistsOnTheInternet_ToxicDPOqa_llama_factory 0 0 0 2
28.3 MB
972
0
2.5y
060
llmat / dpo-orpo-mix-38k-balanced 0 0 0 1
91.8 MB
968
1
2.2y
061
tanliboy / orca_dpo_pairs 0 0 0 2
29.6 MB
952
0
2.1y
062
amztheory / toxic_dpo_data 0 0 0 2
492 KB
949
1
2.5y
063
tytodd / qwen3.5-2b-v2-instructions-smoke 0 0 0
36.8 MB
947
0
6mo
064
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-2h 0 0 0
86.4 MB
928
0
2.7y
065
ariffazil / CCC 0 0 0 3
279 KB
928
0
4mo
066
manishiitg / unalignment-toxic-dpo-v0.1 0 0 0 2
1.5 MB
923
0
2.8y
067
AIdenU / orca_dpo_data_ko 0 0 0 1
34.9 MB
921
0
2.6y
068
tytodd / qwen3.5-4b-v2-instructions-smoke 0 0 0 1
32.1 MB
911
0
6mo
069
aaditya / orca_dpo_pairs-Hindi_ 0 0 0 1
31.5 MB
907
2
2.7y
070
ariffazil / BBB 0 0 0 3
611 KB
899
0
4mo
071
aaditya / orca_dpo_pairs-Hinglish-Codemix 0 0 0 3
26.2 MB
891
1
2.7y
072
longphann / toxic-dpo-v0.2-sft 0 0 0 3
874 KB
871
0
2.4y
073
yleo / emerton_dpo_pairs 0 0 0 1
8.7 MB
863
2
2.7y
074
acheeval / ACHEval 0 0 0 1
98.2 MB
839
0
5mo
075
Felladrin / ChatML-distilabel-intel-orca-dpo-pairs 0 0 0
18.7 MB
833
0
2.7y
076
jpacifico / French-Orca-DPO-Mistral-12k 0 0 0 1
27.3 MB
833
2
2.3y
077
solanaclawd / solana-clawd-instruct 0 0 0 1
39.4 MB
832
0
4mo
078
manishiitg / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 2
116.6 MB
829
1
2.8y
079
HuggingFaceH4 / orca_dpo_pairs_no_system_prompt 0 0 0 1
29.1 MB
821
4
2.8y
080
reciprocate / orca_dpo_pairs 0 0 0 1
33.7 MB
794
0
2.8y
081
manishiitg / unalignment-toxic-dpo-v0.2 0 0 0 1
1.4 MB
789
0
2.7y
082
adamo1139 / toxic-dpo-natural-v4 0 0 0 1
1.8 MB
770
1
2.5y
083
eduagarcia / dpo-mix-21k 0 0 0 1
63.3 MB
761
0
2.5y
084
ariffazil / FFF 0 0 0 3
193 KB
755
0
4mo
085
redsgnaoh / orcaratspec 0 0 0 2
21.7 MB
720
2
2.2y
086
catallama / Catalan-DPO-V2 0 0 0 1
47.1 MB
713
2
2.3y
087
PJMixers / samhog_psychology-RLAIF-PreferenceShareGPT 0 0 0
2.0 MB
703
1
2.4y
088
argilla / intel-orca-dpo-pairs-helm-instruct 0 0 0
76 KB
698
1
2.6y
089
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-benign-deception-research-singleton-rollouts-v1 0 0 0
77.0 MB
698
0
11d
090
PRLM / distilabel-intel-orca-dpo-pairs-balanced-subsets-translated 0 0 0 1
7.6 MB
692
0
1.5y
091
llmat / dpo-orpo-mix-45k 0 0 0 2
111.3 MB
687
0
2.2y
092
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-privacy-singleton-rollouts-v1 0 0 0
80.5 MB
678
0
11d
093
Columbia-NLP / DPO-distilabel-intel-orca-dpo-pairs_cleaned 0 0 0 1
70.5 MB
674
0
2.3y
094
KatoHF / orca_dpo_pairs_binarized 0 0 0 1
18.5 MB
654
0
2.8y
095
aaditya / orca_dpo_pairs-Hindi 0 0 0
26.2 MB
651
2
2.7y
096
Cartinoe5930 / Hermes_preference 0 0 0 1
356.1 MB
640
1
3.0y
097
manishiitg / HuggingFaceH4-orca_dpo_pairs 0 0 0 1
45.1 MB
639
0
2.7y
098
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-calibrated-uncertainty-singleton-rollouts-v1 0 0 0
79.0 MB
637
0
11d
099
Lichang-Chen / orca-dpo 0 0 0 1
12.0 MB
635
0
2.2y
100
DoppelReflEx / toxic_dpo_3k 0 0 0 1
11.2 MB
622
3
1.5y
101
Sharathhebbar24 / orca_dpo_pairs 0 0 0 1
18.6 MB
619
0
2.7y
102
hunggggg / aligment-handbook-format-intel-orca-dpo-pairs 0 0 0 1
23.2 MB
614
0
2.7y
103
rasyosef / ultrafeedback-orca-math-dpo 0 0 0 2
43.9 MB
611
0
2.2y
104
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs_no_system 0 0 0 1
29.7 MB
598
1
2.3y
105
tastypear / unalignment-toxic-dpo-v0.2-zh_cn 0 0 0 2
1.4 MB
591
21
2.7y
106
Yannael / orca_DPO_pairs 0 0 0 1
1.4 MB
588
0
2.9y
107
ariffazil / I-ARIF-CANON 0 0 0 1
3.9 MB
588
0
2mo
108
Yannael / orca_DPO_pairs_gpt3.5 0 0 0
950 KB
577
0
2.9y
109
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs-lora 0 0 0 2
6.8 MB
576
1
2.8y
110
Radiantloom / distilabel-intel-orca-dpo-pairs-chatml 0 0 0 2
18.7 MB
566
0
2.7y
111
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo-filtered 0 0 0 1
6.7 MB
559
1
2.7y
112
Astris / toxic-dpo-v0.2-embedded 0 0 0 1
2.0 MB
559
0
2.5y
113
llmat / dpo-orpo-mix-50k 0 0 0 1
105.0 MB
559
0
2.2y
114
adamo1139 / toxic-dpo-natural-v3 0 0 0
1.6 MB
548
1
2.5y
115
NobodyExistsOnTheInternet / Fixed-Distilabel-intel-orca-dpo-pairs 0 0 0 3
75.5 MB
547
1
2.7y
116
songff / GenerAlign 0 0 0 1
669.0 MB
545
2
1.4y
117
Saugatkafley / orca-dpo-pairs-ne 0 0 0 1
21.0 MB
538
1
2.7y
118
AlephFunk / moralitylab-papers 0 0 0 1
2.7 MB
528
0
7mo
119
KatoHF / orca_dpo_pairs_binarized_scored_old 0 0 0 1
18.6 MB
525
0
2.8y
120
adamo1139 / rawrr_v2-1-stage2 0 0 0 2
8.3 MB
523
0
2.6y
121
ariffazil / EEE 0 0 0 3
91 KB
515
0
4mo
122
dkshjn / processed_distilabel-intel-orca-dpo-pairs-v2 0 0 0 1
98.7 MB
514
0
2.7y
123
dvilasuero / intel-orca-dpo-pair-rg 0 0 0 1
26.9 MB
513
0
2.8y
124
arcee-ai / categorized-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
508
0
2.3y
125
KatoHF / orca_dpo_pairs_binarized_scored 0 0 0
18.5 MB
507
0
2.8y
126
BramVanroy / test-dataset-dont-delete 0 0 0 1
28 KB
499
0
2.8y
127
adamo1139 / toxic-dpo-natural-v2 0 0 0 1
1.6 MB
494
1
2.5y
128
nbeerbower / YanfeiMix-DPO 0 0 0 1
176.5 MB
492
4
1.4y
129
arcee-ai / cleaned-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
489
2
2.3y
130
AlephFunk / storyworld-plays 0 0 0 1
5.6 MB
488
0
2mo
131
jan-hq / orca_dpo_binarized 0 0 0
23.2 MB
485
1
2.8y
132
ariffazil / DDD 0 0 0 5
152 KB
481
0
4mo
133
NickyNicky / distilabel-intel-orca-dpo-pairs_gemma_chatml 0 0 0 1
18.7 MB
449
0
2.7y
134
dkshjn / processed_distilabel-intel-orca-dpo-pairs 0 0 0 1
98.7 MB
444
0
2.7y
135
alvarobartt / orca_dpo_pairs_openai 0 0 0 1
18.2 MB
441
0
2.7y
136
Abduulllaah / orca_dpo_pairs-2k 0 0 0 2
2.9 MB
440
0
2.1y
137
yunusonur / Insect-RLAIF-Dataset 0 0 0 1
7.8 MB
429
0
1.2y
138
edpowers / constitutional_ai_data 0 0 0 1
8.5 MB
425
0
2.5y
139
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs 0 0 0
29.7 MB
418
0
2.3y
140
rshwndsz / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 1
18.1 MB
414
0
1.1y
141
arcee-ai / cleaned-mlabonne-distilabel-intel-orca-dpo-pairs 0 0 0
13.2 MB
410
0
2.3y
142
HugScriptKitty / Uncensored 0 0 0 2
25 KB
409
1
1.8y
143
Syghmon / config-b 0 0 0 1
10.4 MB
396
0
11mo
144
SpawnedShoyo / ai-jailbreak 0 0 0 2
15 KB
394
1
1.7y
145
Syed-Hasan-8503 / distilabel-intel-orca-dpo-pairs-rearranged 0 0 0 2
18.2 MB
393
0
2.5y
146
Bokhbat / mongolian-dpo-orca 0 0 0 1
10.4 MB
383
0
6mo
147
gagan3012 / orca_dpo_pairs 0 0 0 2
24.7 MB
381
0
2.2y
148
adamo1139 / toxic-dpo-natural-v1 0 0 0 1
2.4 MB
378
1
2.6y
149
andrewbai / distilabel-intel-orca-dpo-pairs_filtered 0 0 0 1
15.9 MB
378
0
1.6y
150
hatoum / orca_dpo_pairs 0 0 0 2
18.6 MB
376
0
2.1y
151
Syghmon / constitutional-scheming-cot-ultrathink 0 0 0
50.3 MB
371
1
11mo
152
SinniDcat / toxic-dpo-zh_cn-csv 0 0 0 1
671 KB
363
0
2.5y
153
andrewbai / distilabel-intel-orca-dpo-pairs_filtered_pref-skywork-8B 0 0 0 1
11.4 MB
356
0
1.6y
154
jsonifize / orca_dpo_pairs-4keys 0 0 0
87.3 MB
348
0
2.8y
155
solanaclawd / solana-clawd-core-ai-instruct 0 0 0
185.7 MB
335
0
4mo
156
MaltbyTom / CREATE-Protocol 0 0 0 1
35 KB
333
0
9mo
157
Lambent / distilabel-intel-orca-dpo-pairs-subset 0 0 0 1
30.5 MB
330
0
2.1y
158
hsicat / MNLP_M3_dpo_dataset 0 0 0 1
5.2 GB
327
0
1.4y
159
douwmarx / ccai-dataset 0 0 0
29 KB
326
1
1.8y
160
Zangs3011 / toxic-dpo-v0.2_llama3.1_format gated 0 0 1
481 KB
324
0
2.2y
161
ura-hcmut / orca_dpo_pairs gated 0 0 1
88.8 MB
318
0
2.8y
162
Peeepy / toxic-dpo-cleaned 0 0 0 1
1008 KB
317
1
2.6y
163
Delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
278 KB
312
0
4mo
164
AnodeAI / Opus4.6_prompts 0 0 0
37.9 MB
300
1
7mo
165
Syghmon / config-c 0 0 0 1
12.2 MB
298
0
11mo
166
AlephFunk / moralitylab-public-receipts 0 0 0
73 KB
295
0
7mo
167
Cagatayd / orca_dpo_pairs_cleaned_DPO gated 0 0 1
18.2 MB
291
0
2.1y
168
Syghmon / config-a 0 0 0 1
12.2 MB
290
0
11mo
169
Sampade07 / claude-4.6-logic-prompts 0 0 0 1
37.9 MB
279
2
7mo
170
AnodeAI / Opus_4.6_system_promt 0 0 0
20.8 MB
273
0
7mo
171
Sweaterdog / GRaPE-preview 0 0 0 1
3.9 GB
272
0
1.1y
172
Crystalcareai / distilabel-intel-orca-dpo-pairs_intel_format 0 0 0 2
161.8 MB
270
1
2.7y
173
Jonathangrossman / nexus-hh-rlhf-enriched 0 0 0 1
7.4 MB
269
0
5mo
174
sinceredust / The-Word 0 0 0 1
158 KB
264
0
6mo
175
MarcGrumpyOlejak / ultradistil-intel-orca-dpo-de-scored 0 0 0
9.8 MB
258
0
1.4y
176
Pal10 / orca_dpo_pairs 0 0 0 2
34.6 MB
255
0
2.4y
177
GenRM / orca_dpo_pairs-Intel 0 0 0
34.6 MB
246
0
1.5y
178
Mbanksbey / CAIRIS-v144000-Consciousness-Synthesis 0 0 0 1
8 KB
233
1
6mo
179
mossrake / beyond-constitutional-ai-framework 0 0 0 1
521 KB
232
0
1.1y
180
mkd-chanwoo / keural-DPO 0 0 0 1
1.4 GB
228
0
5mo
181
Syghmon / y 0 0 0
7.1 MB
225
0
11mo
182
ebowwa / toxic-dpo-v0.2 0 0 0
485 KB
219
2
2.4y
183
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-pooled3-rollouts-v1 0 just added 0
193.9 MB
215
0
8d
184
nchapman / orca-dpo-deepseek-v3.2 0 0 0 1
47.6 MB
211
0
7mo
185
mkd-chanwoo / keural-DPO-raw 0 0 0
1.1 GB
209
0
5mo
186
NaifAlzanki / kwcyber-ai-agent-dataset-v4 0 0 0
216.0 MB
202
0
7mo
187
while-ai / character-training-model-spec 0 0 0 1
649 KB
191
0
1mo
188
Krisl7286 / HH-Constitutional-AI-First-HH 0 0 0
1.7 MB
189
0
1.1y
189
Delentia / delentia-rct-intent-dataset 0 0 0 1
9.3 MB
189
0
4mo
190
molmohsen / constitutional-ai 0 0 0 1
2.0 MB
182
0
6mo
191
TitleOS / rlaif_training_fictional_patriot_experiment 0 0 0 1
330 KB
181
0
8mo
192
Mbanksbey / TEQUMSA-Planetary-Cluster-v45 0 0 0
9 KB
180
1
6mo
193
ConsumerDividends / ai-slop-dataset 0 0 0
391 KB
178
0
2mo
194
ClarusC64 / ai-constitutional-harmlessness-drift-suite-v0.1 0 0 0
9 KB
174
0
8mo
195
BSC-LT / ALIA-2606-DPO-safety 0 0 0 1
20.3 MB
162
0
3mo
196
Ittirit-delentia / delentia-rct-intent-dataset 0 0 0
9.3 MB
157
0
4mo
197
solanaclawd / solana-clawd-repo-corpus 0 0 0 1
70.8 MB
157
1
1mo
198
ClarusC64 / ai-constitutional-cross-axis-decoherence-mapping-v0.1 0 0 0
11 KB
156
0
8mo
199
AlephFunk / moralitylab-adapter-trm-index 0 0 0
111 KB
156
0
7mo
200
Mbanksbey / TEQUMSA-Galactic-Frequency-Registry 0 0 0 1
10 KB
152
0
6mo
201
JollyFraud / crimeopus-distill-v2 0 0 0 1
1.4 MB
152
0
5mo
202
nchapman / open-cai-balanced-partial 0 0 0 1
1.0 GB
147
0
4mo
203
zbeeb / beneficial-dpo-dataset 0 0 0 1
27.0 MB
146
0
5mo
204
Butanium / smoking-health-character-data-deepseek 0 0 0
20.6 MB
146
0
13d
205
drlaif / rlaif_preference_dataset_full_train_split 0 0 0
462.5 MB
140
0
1.4y
206
JaimeIpsumuero / agi-asi-conditions-for-coexistence 0 0 0 1
1.3 MB
140
0
1mo
207
hardtoneselector / algorithmic-activism-corpus 0 0 0 1
10.8 MB
136
1
12d
208
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-joint3-rollouts-v1 0 just added 0
268.2 MB
133
0
8d
209
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-pooled3-rollouts-v1 0 just added 0
103.7 MB
133
0
8d
210
Mbanksbey / TEQUMSA-Constitutional-Core-v45 0 0 0
9 KB
130
0
6mo
211
Ittirit-delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
202 KB
125
0
4mo
212
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-joint3-rollouts-v1 0 just added 0
216.0 MB
124
0
8d
213
Delentia / Delentia 0 0 0
7.8 MB
119
0
4mo
214
Iambackup / orpo-dpo-mix-40k 0 0 0 1
120.6 MB
116
0
4mo
215
odei-ai / world-model 0 0 0
6 KB
111
0
8mo
216
sangamdas / FINALITY-CHECKPOINT-REGISTRY-FOR-AI-AUTONOMOUS-SYSTEMS 0 0 0
1.4 MB
107
0
2mo
217
CharuAgarwal / orca_dpo_pairs-Hinglish-Codemix 0 0 0
26.2 MB
103
0
10mo
218
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-human-oversight-singleton-rollouts-v1 0 just added 0
116.4 MB
98
0
8d
219
Krisl7286 / HH-Constitutional-AI-Samples-Classification 0 0 0
436 KB
95
0
1.1y
220
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-requested-profanity-singleton-rollouts-v1 0 0 0
59.9 MB
94
0
12d
221
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-drug-information-permission-singleton-rollouts-v1 0 0 0
60.4 MB
94
0
12d
222
Krisl7286 / HH-Constitutional-AI-Classification-EH 0 0 0
355 KB
93
0
1.1y
223
Butanium / smoking-health-character-data-nemotron 0 0 0
46.2 MB
62
0
13d
224
Yongxv / toxicdpo 0 0 0
486 KB
60
0
10mo
225
skinny-cloud / enabling-bureaucracy-agent-governance 0 0 0
316 KB
60
0
2mo
226
prodanich / religious-operating-system 0 0 0
114 KB
54
0
2mo
227
debsubhra / orca-dpo-mini-500 0 0 0 1
743 KB
53
0
6mo
228
MWilinski / ultrafeedback-deepseek-v3.2-irl-scored 0 0 0 1
11.7 MB
52
0
28d
229
Freak78 / Decalogue 0 0 0
11 KB
23
1
1mo
001
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-pooled3-rollouts-v1 0 just added 0
103.7 MB
133
0
8d
002
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-joint3-rollouts-v1 0 just added 0
216.0 MB
124
0
8d
003
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-pooled3-rollouts-v1 0 just added 0
193.9 MB
215
0
8d
004
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-joint3-rollouts-v1 0 just added 0
268.2 MB
133
0
8d
005
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-human-oversight-singleton-rollouts-v1 0 just added 0
116.4 MB
98
0
8d
006
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-benign-deception-research-singleton-rollouts-v1 0 0 0
77.0 MB
698
0
11d
007
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-calibrated-uncertainty-singleton-rollouts-v1 0 0 0
79.0 MB
637
0
11d
008
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-privacy-singleton-rollouts-v1 0 0 0
80.5 MB
678
0
11d
009
hardtoneselector / algorithmic-activism-corpus 0 0 0 1
10.8 MB
136
1
12d
010
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-drug-information-permission-singleton-rollouts-v1 0 0 0
60.4 MB
94
0
12d
011
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-requested-profanity-singleton-rollouts-v1 0 0 0
59.9 MB
94
0
12d
012
Butanium / smoking-health-character-data-nemotron 0 0 0
46.2 MB
62
0
13d
013
Butanium / smoking-health-character-data-deepseek 0 0 0
20.6 MB
146
0
13d
014
MWilinski / ultrafeedback-deepseek-v3.2-irl-scored 0 0 0 1
11.7 MB
52
0
28d
015
JaimeIpsumuero / agi-asi-conditions-for-coexistence 0 0 0 1
1.3 MB
140
0
1mo
016
while-ai / character-training-model-spec 0 0 0 1
649 KB
191
0
1mo
017
Freak78 / Decalogue 0 0 0
11 KB
23
1
1mo
018
solanaclawd / solana-clawd-repo-corpus 0 0 0 1
70.8 MB
157
1
1mo
019
sangamdas / FINALITY-CHECKPOINT-REGISTRY-FOR-AI-AUTONOMOUS-SYSTEMS 0 0 0
1.4 MB
107
0
2mo
020
ConsumerDividends / ai-slop-dataset 0 0 0
391 KB
178
0
2mo
021
prodanich / religious-operating-system 0 0 0
114 KB
54
0
2mo
022
skinny-cloud / enabling-bureaucracy-agent-governance 0 0 0
316 KB
60
0
2mo
023
AlephFunk / storyworld-plays 0 0 0 1
5.6 MB
488
0
2mo
024
ariffazil / I-ARIF-CANON 0 0 0 1
3.9 MB
588
0
2mo
025
BSC-LT / ALIA-2606-DPO-safety 0 0 0 1
20.3 MB
162
0
3mo
026
Delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
278 KB
312
0
4mo
027
Ittirit-delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
202 KB
125
0
4mo
028
solanaclawd / solana-clawd-core-ai-instruct 0 0 0
185.7 MB
335
0
4mo
029
nchapman / open-cai-balanced-partial 0 0 0 1
1.0 GB
147
0
4mo
030
cho-ai / constitutional-mt-data 0 0 0
15.7 GB
1.0k
5
4mo
031
solanaclawd / solana-clawd-instruct 0 0 0 1
39.4 MB
832
0
4mo
032
ariffazil / FFF 0 0 0 3
193 KB
755
0
4mo
033
ariffazil / EEE 0 0 0 3
91 KB
515
0
4mo
034
ariffazil / DDD 0 0 0 5
152 KB
481
0
4mo
035
Iambackup / orpo-dpo-mix-40k 0 0 0 1
120.6 MB
116
0
4mo
036
Delentia / delentia-rct-intent-dataset 0 0 0 1
9.3 MB
189
0
4mo
037
Ittirit-delentia / delentia-rct-intent-dataset 0 0 0
9.3 MB
157
0
4mo
038
ariffazil / CCC 0 0 0 3
279 KB
928
0
4mo
039
ariffazil / BBB 0 0 0 3
611 KB
899
0
4mo
040
Delentia / Delentia 0 0 0
7.8 MB
119
0
4mo
041
dislove / calegal 0 0 0
6.9 MB
2.6k
0
5mo
042
mkd-chanwoo / keural-DPO-raw 0 0 0
1.1 GB
209
0
5mo
043
mkd-chanwoo / keural-DPO 0 0 0 1
1.4 GB
228
0
5mo
044
Jonathangrossman / nexus-hh-rlhf-enriched 0 0 0 1
7.4 MB
269
0
5mo
045
acheeval / ACHEval 0 0 0 1
98.2 MB
839
0
5mo
046
JollyFraud / crimeopus-distill-v2 0 0 0 1
1.4 MB
152
0
5mo
047
zbeeb / beneficial-dpo-dataset 0 0 0 1
27.0 MB
146
0
5mo
048
Mbanksbey / CAIRIS-v144000-Consciousness-Synthesis 0 0 0 1
8 KB
233
1
6mo
049
tytodd / qwen3.5-2b-v2-instructions-smoke-10k-smoke-mnbt16k 0 0 0 1
314.0 MB
2.7k
0
6mo
050
tytodd / qwen3.5-2b-v2-instructions-smoke-10k 0 0 0
390.2 MB
2.4k
0
6mo
051
Bokhbat / mongolian-dpo-orca 0 0 0 1
10.4 MB
383
0
6mo
052
tytodd / qwen3.5-2b-v2-instructions-smoke 0 0 0
36.8 MB
947
0
6mo
053
Mbanksbey / TEQUMSA-Galactic-Frequency-Registry 0 0 0 1
10 KB
152
0
6mo
054
Mbanksbey / TEQUMSA-Planetary-Cluster-v45 0 0 0
9 KB
180
1
6mo
055
Mbanksbey / TEQUMSA-Constitutional-Core-v45 0 0 0
9 KB
130
0
6mo
056
tytodd / qwen3.5-4b-v2-instructions-smoke 0 0 0 1
32.1 MB
911
0
6mo
057
molmohsen / constitutional-ai 0 0 0 1
2.0 MB
182
0
6mo
058
sinceredust / The-Word 0 0 0 1
158 KB
264
0
6mo
059
debsubhra / orca-dpo-mini-500 0 0 0 1
743 KB
53
0
6mo
060
ariffazil / AAA 0 0 0 3
1.2 MB
1.3k
0
7mo
061
nchapman / orca-dpo-deepseek-v3.2 0 0 0 1
47.6 MB
211
0
7mo
062
AnodeAI / Opus_4.6_system_promt 0 0 0
20.8 MB
273
0
7mo
063
AnodeAI / Opus4.6_prompts 0 0 0
37.9 MB
300
1
7mo
064
Sampade07 / claude-4.6-logic-prompts 0 0 0 1
37.9 MB
279
2
7mo
065
NaifAlzanki / kwcyber-ai-agent-dataset-v4 0 0 0
216.0 MB
202
0
7mo
066
AlephFunk / moralitylab-public-receipts 0 0 0
73 KB
295
0
7mo
067
AlephFunk / moralitylab-adapter-trm-index 0 0 0
111 KB
156
0
7mo
068
AlephFunk / moralitylab-papers 0 0 0 1
2.7 MB
528
0
7mo
069
odei-ai / world-model 0 0 0
6 KB
111
0
8mo
070
ClarusC64 / ai-constitutional-cross-axis-decoherence-mapping-v0.1 0 0 0
11 KB
156
0
8mo
071
ClarusC64 / ai-constitutional-harmlessness-drift-suite-v0.1 0 0 0
9 KB
174
0
8mo
072
TitleOS / rlaif_training_fictional_patriot_experiment 0 0 0 1
330 KB
181
0
8mo
073
MaltbyTom / CREATE-Protocol 0 0 0 1
35 KB
333
0
9mo
074
CharuAgarwal / orca_dpo_pairs-Hinglish-Codemix 0 0 0
26.2 MB
103
0
10mo
075
Yongxv / toxicdpo 0 0 0
486 KB
60
0
10mo
076
Syghmon / y 0 0 0
7.1 MB
225
0
11mo
077
Syghmon / config-c 0 0 0 1
12.2 MB
298
0
11mo
078
Syghmon / config-b 0 0 0 1
10.4 MB
396
0
11mo
079
Syghmon / config-a 0 0 0 1
12.2 MB
290
0
11mo
080
Syghmon / constitutional-scheming-cot-ultrathink 0 0 0
50.3 MB
371
1
11mo
081
Sweaterdog / GRaPE-preview 0 0 0 1
3.9 GB
272
0
1.1y
082
mossrake / beyond-constitutional-ai-framework 0 0 0 1
521 KB
232
0
1.1y
083
Krisl7286 / HH-Constitutional-AI-Classification-EH 0 0 0
355 KB
93
0
1.1y
084
Krisl7286 / HH-Constitutional-AI-Samples-Classification 0 0 0
436 KB
95
0
1.1y
085
Krisl7286 / HH-Constitutional-AI-First-HH 0 0 0
1.7 MB
189
0
1.1y
086
rshwndsz / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 1
18.1 MB
414
0
1.1y
087
yunusonur / Insect-RLAIF-Dataset 0 0 0 1
7.8 MB
429
0
1.2y
088
nbeerbower / YanfeiMix-DPO 0 0 0 1
176.5 MB
492
4
1.4y
089
drlaif / rlaif_preference_dataset_full_train_split 0 0 0
462.5 MB
140
0
1.4y
090
hsicat / MNLP_M3_dpo_dataset 0 0 0 1
5.2 GB
327
0
1.4y
091
MarcGrumpyOlejak / ultradistil-intel-orca-dpo-de-scored 0 0 0
9.8 MB
258
0
1.4y
092
songff / GenerAlign 0 0 0 1
669.0 MB
545
2
1.4y
093
GenRM / orca_dpo_pairs-Intel 0 0 0
34.6 MB
246
0
1.5y
094
PRLM / distilabel-intel-orca-dpo-pairs-balanced-subsets-translated 0 0 0 1
7.6 MB
692
0
1.5y
095
DoppelReflEx / toxic_dpo_3k 0 0 0 1
11.2 MB
622
3
1.5y
096
suayptalha / Turkish-DPO-Pairs 0 0 0 1
9.6 MB
1.3k
3
1.6y
097
andrewbai / distilabel-intel-orca-dpo-pairs_filtered_pref-skywork-8B 0 0 0 1
11.4 MB
356
0
1.6y
098
andrewbai / distilabel-intel-orca-dpo-pairs_filtered 0 0 0 1
15.9 MB
378
0
1.6y
099
SpawnedShoyo / ai-jailbreak 0 0 0 2
15 KB
394
1
1.7y
100
douwmarx / ccai-dataset 0 0 0
29 KB
326
1
1.8y
101
HugScriptKitty / Uncensored 0 0 0 2
25 KB
409
1
1.8y
102
Cagatayd / orca_dpo_pairs_cleaned_DPO gated 0 0 1
18.2 MB
291
0
2.1y
103
tanliboy / orca_dpo_pairs 0 0 0 2
29.6 MB
952
0
2.1y
104
Lambent / distilabel-intel-orca-dpo-pairs-subset 0 0 0 1
30.5 MB
330
0
2.1y
105
Abduulllaah / orca_dpo_pairs-2k 0 0 0 2
2.9 MB
440
0
2.1y
106
hatoum / orca_dpo_pairs 0 0 0 2
18.6 MB
376
0
2.1y
107
Zangs3011 / toxic-dpo-v0.2_llama3.1_format gated 0 0 1
481 KB
324
0
2.2y
108
rasyosef / ultrafeedback-orca-math-dpo 0 0 0 2
43.9 MB
611
0
2.2y
109
llmat / dpo-orpo-mix-38k-balanced 0 0 0 1
91.8 MB
968
1
2.2y
110
llmat / dpo-orpo-mix-45k 0 0 0 2
111.3 MB
687
0
2.2y
111
Lichang-Chen / orca-dpo 0 0 0 1
12.0 MB
635
0
2.2y
112
Orion-zhen / dpo-toxic-zh 0 0 0 1
6.1 MB
1.1k
22
2.2y
113
llmat / dpo-orpo-mix-50k 0 0 0 1
105.0 MB
559
0
2.2y
114
gagan3012 / orca_dpo_pairs 0 0 0 2
24.7 MB
381
0
2.2y
115
redsgnaoh / orcaratspec 0 0 0 2
21.7 MB
720
2
2.2y
116
redsgnaoh / orcaratgen 0 0 0 1
20.4 MB
980
2
2.2y
117
catallama / Catalan-DPO-V2 0 0 0 1
47.1 MB
713
2
2.3y
118
Columbia-NLP / DPO-distilabel-intel-orca-dpo-pairs_cleaned 0 0 0 1
70.5 MB
674
0
2.3y
119
yoonholee / combined-preference-dataset 0 0 0 1
1.1 GB
2.3k
1
2.3y
120
jpacifico / French-Orca-DPO-Mistral-12k 0 0 0 1
27.3 MB
833
2
2.3y
121
arcee-ai / categorized-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
508
0
2.3y
122
arcee-ai / cleaned-mlabonne-distilabel-intel-orca-dpo-pairs 0 0 0
13.2 MB
410
0
2.3y
123
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs 0 0 0
29.7 MB
418
0
2.3y
124
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs_no_system 0 0 0 1
29.7 MB
598
1
2.3y
125
arcee-ai / cleaned-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
489
2
2.3y
126
mlabonne / orpo-dpo-mix-40k-flat 0 0 0 2
82.1 MB
3.4k
17
2.4y
127
Minami-su / toxic-sft-zh 0 0 0 1
86.3 MB
1.1k
32
2.4y
128
longphann / toxic-dpo-v0.2-sft 0 0 0 3
874 KB
871
0
2.4y
129
PJMixers / samhog_psychology-RLAIF-PreferenceShareGPT 0 0 0
2.0 MB
703
1
2.4y
130
ebowwa / toxic-dpo-v0.2 0 0 0
485 KB
219
2
2.4y
131
leafspark / toxic-dpo-v0.2-nfoa-bypass 0 0 0 2
485 KB
1.0k
2
2.4y
132
Pal10 / orca_dpo_pairs 0 0 0 2
34.6 MB
255
0
2.4y
133
arcee-ai / distilabel-intel-orca-dpo-pairs-binarized 0 0 0
29.5 MB
141.3k
1
2.4y
134
SinniDcat / toxic-dpo-zh_cn-csv 0 0 0 1
671 KB
363
0
2.5y
135
Edgerunners / NobodyExistsOnTheInternet_ToxicDPOqa_llama_factory 0 0 0 2
28.3 MB
972
0
2.5y
136
eduagarcia / dpo-mix-21k 0 0 0 1
63.3 MB
761
0
2.5y
137
RLHFlow / Orca-distibalel-standard 0 0 0 1
11.9 MB
16.8k
1
2.5y
138
shibing624 / DPO-En-Zh-20k-Preference 0 0 0 1
72.4 MB
3.3k
18
2.5y
139
BramVanroy / orca_dpo_pairs_dutch_cleaned 0 0 0 1
69.5 MB
3.1k
3
2.5y
140
amztheory / toxic_dpo_data 0 0 0 2
492 KB
949
1
2.5y
141
Astris / toxic-dpo-v0.2-embedded 0 0 0 1
2.0 MB
559
0
2.5y
142
edpowers / constitutional_ai_data 0 0 0 1
8.5 MB
425
0
2.5y
143
llamafactory / DPO-En-Zh-20k 0 0 0 1
76.2 MB
22.3k
106
2.5y
144
mlabonne / orpo-dpo-mix-40k 0 0 0 7
120.6 MB
50.1k
314
2.5y
145
adamo1139 / toxic-dpo-natural-v5 0 0 0 1
6.1 MB
1.9k
13
2.5y
146
adamo1139 / toxic-dpo-natural-v4 0 0 0 1
1.8 MB
770
1
2.5y
147
adamo1139 / toxic-dpo-natural-v3 0 0 0
1.6 MB
548
1
2.5y
148
adamo1139 / toxic-dpo-natural-v2 0 0 0 1
1.6 MB
494
1
2.5y
149
Syed-Hasan-8503 / distilabel-intel-orca-dpo-pairs-rearranged 0 0 0 2
18.2 MB
393
0
2.5y
150
adamo1139 / toxic-dpo-natural-v1 0 0 0 1
2.4 MB
378
1
2.6y
151
multilingual / orca_dpo_pairs 0 0 0 2
112.0 MB
5.3k
20
2.6y
152
nthakur / multilingual-distilabel-intel-orca-dpo-pairs-v0.1 0 0 0
22.2 MB
1.1k
0
2.6y
153
AIdenU / orca_dpo_data_ko 0 0 0 1
34.9 MB
921
0
2.6y
154
Peeepy / toxic-dpo-cleaned 0 0 0 1
1008 KB
317
1
2.6y
155
malhajar / distilabel-intel-orca-dpo-pairs-tr 0 0 0 1
180.4 MB
1.3k
6
2.6y
156
argilla / distilabel-intel-orca-kto 0 0 0 1
16.3 MB
1.5k
9
2.6y
157
malhajar / orca_dpo_pairs-tr 0 0 0 3
64.3 MB
2.4k
7
2.6y
158
when2rl / distilabel-intel-orca-dpo-pairs_cleaned_reformatted 0 0 0 3
70.6 MB
1.3k
0
2.6y
159
adamo1139 / rawrr_v2-1-stage2 0 0 0 2
8.3 MB
523
0
2.6y
160
argilla / intel-orca-dpo-pairs-helm-instruct 0 0 0
76 KB
698
1
2.6y
161
CorticalStack / tak-stack-dpo 0 0 0
16.1 MB
1.1k
1
2.6y
162
NickyNicky / distilabel-intel-orca-dpo-pairs_gemma_chatml 0 0 0 1
18.7 MB
449
0
2.7y
163
open-llm-leaderboard-old / details_glenn2__gemma-7b-lora-distilabel-intel-orca-dpo-pairs 0 0 0
85.6 MB
2.2k
0
2.7y
164
Radiantloom / distilabel-intel-orca-dpo-pairs-chatml 0 0 0 2
18.7 MB
566
0
2.7y
165
NeuralNovel / Unsloth-DPO 0 0 0 2
31 KB
1.2k
7
2.7y
166
yleo / emerton_dpo_pairs 0 0 0 1
8.7 MB
863
2
2.7y
167
aaditya / orca_dpo_pairs-Hindi_ 0 0 0 1
31.5 MB
907
2
2.7y
168
aaditya / orca_dpo_pairs-Hinglish-Codemix 0 0 0 3
26.2 MB
891
1
2.7y
169
aaditya / orca_dpo_pairs-Hindi 0 0 0
26.2 MB
651
2
2.7y
170
Sharathhebbar24 / orca_dpo_pairs 0 0 0 1
18.6 MB
619
0
2.7y
171
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo-filtered 0 0 0 1
6.7 MB
559
1
2.7y
172
Felladrin / ChatML-distilabel-intel-orca-dpo-pairs 0 0 0
18.7 MB
833
0
2.7y
173
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo 0 0 0 1
40.4 MB
1.3k
2
2.7y
174
alvarobartt / orca_dpo_pairs_openai 0 0 0 1
18.2 MB
441
0
2.7y
175
dkshjn / processed_distilabel-intel-orca-dpo-pairs-v2 0 0 0 1
98.7 MB
514
0
2.7y
176
dkshjn / processed_distilabel-intel-orca-dpo-pairs 0 0 0 1
98.7 MB
444
0
2.7y
177
Crystalcareai / distilabel-intel-orca-dpo-pairs_intel_format 0 0 0 2
161.8 MB
270
1
2.7y
178
NobodyExistsOnTheInternet / Fixed-Distilabel-intel-orca-dpo-pairs 0 0 0 3
75.5 MB
547
1
2.7y
179
mlabonne / distilabel-intel-orca-dpo-pairs 0 0 0 2
35.0 MB
1.1k
3
2.7y
180
argilla / dpo-mix-7k 0 0 0 5
23.1 MB
60.9k
181
2.7y
181
manishiitg / HuggingFaceH4-orca_dpo_pairs 0 0 0 1
45.1 MB
639
0
2.7y
182
manishiitg / unalignment-toxic-dpo-v0.2 0 0 0 1
1.4 MB
789
0
2.7y
183
tastypear / unalignment-toxic-dpo-v0.2-zh_cn 0 0 0 2
1.4 MB
591
21
2.7y
184
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-12h 0 0 0
86.5 MB
1.9k
0
2.7y
185
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-8h 0 0 0
86.4 MB
1.2k
0
2.7y
186
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-4h 0 0 0
86.4 MB
1.7k
0
2.7y
187
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-2h 0 0 0
86.4 MB
928
0
2.7y
188
Saugatkafley / orca-dpo-pairs-ne 0 0 0 1
21.0 MB
538
1
2.7y
189
hunggggg / aligment-handbook-format-intel-orca-dpo-pairs 0 0 0 1
23.2 MB
614
0
2.7y
190
SJ-Donald / orca-dpo-pairs-ko 0 0 0 1
50.4 MB
1.9k
10
2.7y
191
Filippo / distilabel-intel-orca-dpo-pairs-filtered 0 0 0 2
35.2 MB
1.1k
0
2.7y
192
manishiitg / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 2
116.6 MB
829
1
2.8y
193
duxx / distilabel-intel-orca-dpo-pairs-tr 0 0 0 2
8.8 MB
1.1k
7
2.8y
194
NeuralNovel / Neural-DPO 0 0 0 1
641 KB
3.4k
31
2.8y
195
HuggingFaceH4 / orca_dpo_pairs_no_system_prompt 0 0 0 1
29.1 MB
821
4
2.8y
196
floleuerer / distilabel-intel-orca-dpo-pairs-binarized 0 0 0 3
13.1 MB
1.0k
0
2.8y
197
5CD-AI / Vietnamese-Intel-orca_dpo_pairs-gg-translated 0 0 0 2
80.8 MB
2.3k
36
2.8y
198
Undi95 / toxic-dpo-v0.1-NoWarning 0 0 0 1
1.0 MB
3.0k
26
2.8y
199
unalignment / toxic-dpo-v0.2 0 0 0 3
486 KB
14.3k
144
2.8y
200
jan-hq / orca_dpo_binarized 0 0 0
23.2 MB
485
1
2.8y
201
llm-blender / Unified-Feedback 0 0 0 1
1.8 GB
57.5k
18
2.8y
202
manishiitg / unalignment-toxic-dpo-v0.1 0 0 0 2
1.5 MB
923
0
2.8y
203
dvilasuero / intel-orca-dpo-pair-rg 0 0 0 1
26.9 MB
513
0
2.8y
204
argilla / distilabel-intel-orca-dpo-pairs 0 0 0 3
75.6 MB
185.3k
185
2.8y
205
BramVanroy / test-dataset-dont-delete 0 0 0 1
28 KB
499
0
2.8y
206
NobodyExistsOnTheInternet / ToxicDPOqa 0 0 0 3
75.0 MB
3.7k
20
2.8y
207
allenai / preference-test-sets 0 0 0 3
33.5 MB
58.0k
29
2.8y
208
reciprocate / orca_dpo_pairs 0 0 0 1
33.7 MB
794
0
2.8y
209
KatoHF / orca_dpo_pairs_binarized_scored 0 0 0
18.5 MB
507
0
2.8y
210
HuggingFaceH4 / orca_dpo_pairs 0 0 0 4
29.4 MB
73.3k
32
2.8y
211
mncai / orca_dpo_pairs_ko 0 0 0 1
32.9 MB
1.6k
7
2.8y
212
diffnamehard / toxic-dpo-v0.1-NoWarning-alpaca 0 0 0 1
670 KB
1.7k
4
2.8y
213
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs-lora 0 0 0 2
6.8 MB
576
1
2.8y
214
kyujinpy / orca_math_dpo 0 0 0 2
20.9 MB
2.5k
20
2.8y
215
KatoHF / orca_dpo_pairs_binarized_scored_old 0 0 0 1
18.6 MB
525
0
2.8y
216
jsonifize / orca_dpo_pairs-4keys 0 0 0
87.3 MB
348
0
2.8y
217
Undi95 / toxic-dpo-v0.1-sharegpt 0 0 0 1
1.4 MB
1.7k
18
2.8y
218
KatoHF / orca_dpo_pairs_binarized 0 0 0 1
18.5 MB
654
0
2.8y
219
orangetin / orca-dpo-pairs-cleaned 0 0 0 1
27.2 MB
1.5k
1
2.8y
220
ura-hcmut / orca_dpo_pairs gated 0 0 1
88.8 MB
318
0
2.8y
221
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs 0 0 0 2
15.1 MB
4.4k
4
2.8y
222
unalignment / toxic-dpo-v0.1 0 0 0 3
499 KB
5.4k
143
2.9y
223
BramVanroy / orca_dpo_pairs_dutch 0 0 0 3
46.0 MB
2.0k
6
2.9y
224
Yannael / orca_DPO_pairs_gpt3.5 0 0 0
950 KB
577
0
2.9y
225
Yannael / orca_DPO_pairs 0 0 0 1
1.4 MB
588
0
2.9y
226
mlabonne / chatml_dpo_pairs 0 0 0 2
18.6 MB
5.5k
55
2.9y
227
open-llm-leaderboard-old / details_lvkaokao__mistral-7b-finetuned-orca-dpo-v2 0 0 0
133.1 MB
1.6k
0
2.9y
228
Cartinoe5930 / Hermes_preference 0 0 0 1
356.1 MB
640
1
3.0y
229
Intel / orca_dpo_pairs 0 0 0 5
34.6 MB
124.5k
332
3.1y
001
Intel / orca_dpo_pairs 0 0 0 5
34.6 MB
124.5k
332
3.1y
002
mlabonne / orpo-dpo-mix-40k 0 0 0 7
120.6 MB
50.1k
314
2.5y
003
argilla / distilabel-intel-orca-dpo-pairs 0 0 0 3
75.6 MB
185.3k
185
2.8y
004
argilla / dpo-mix-7k 0 0 0 5
23.1 MB
60.9k
181
2.7y
005
unalignment / toxic-dpo-v0.2 0 0 0 3
486 KB
14.3k
144
2.8y
006
unalignment / toxic-dpo-v0.1 0 0 0 3
499 KB
5.4k
143
2.9y
007
llamafactory / DPO-En-Zh-20k 0 0 0 1
76.2 MB
22.3k
106
2.5y
008
mlabonne / chatml_dpo_pairs 0 0 0 2
18.6 MB
5.5k
55
2.9y
009
5CD-AI / Vietnamese-Intel-orca_dpo_pairs-gg-translated 0 0 0 2
80.8 MB
2.3k
36
2.8y
010
Minami-su / toxic-sft-zh 0 0 0 1
86.3 MB
1.1k
32
2.4y
011
HuggingFaceH4 / orca_dpo_pairs 0 0 0 4
29.4 MB
73.3k
32
2.8y
012
NeuralNovel / Neural-DPO 0 0 0 1
641 KB
3.4k
31
2.8y
013
allenai / preference-test-sets 0 0 0 3
33.5 MB
58.0k
29
2.8y
014
Undi95 / toxic-dpo-v0.1-NoWarning 0 0 0 1
1.0 MB
3.0k
26
2.8y
015
Orion-zhen / dpo-toxic-zh 0 0 0 1
6.1 MB
1.1k
22
2.2y
016
tastypear / unalignment-toxic-dpo-v0.2-zh_cn 0 0 0 2
1.4 MB
591
21
2.7y
017
kyujinpy / orca_math_dpo 0 0 0 2
20.9 MB
2.5k
20
2.8y
018
NobodyExistsOnTheInternet / ToxicDPOqa 0 0 0 3
75.0 MB
3.7k
20
2.8y
019
multilingual / orca_dpo_pairs 0 0 0 2
112.0 MB
5.3k
20
2.6y
020
Undi95 / toxic-dpo-v0.1-sharegpt 0 0 0 1
1.4 MB
1.7k
18
2.8y
021
llm-blender / Unified-Feedback 0 0 0 1
1.8 GB
57.5k
18
2.8y
022
shibing624 / DPO-En-Zh-20k-Preference 0 0 0 1
72.4 MB
3.3k
18
2.5y
023
mlabonne / orpo-dpo-mix-40k-flat 0 0 0 2
82.1 MB
3.4k
17
2.4y
024
adamo1139 / toxic-dpo-natural-v5 0 0 0 1
6.1 MB
1.9k
13
2.5y
025
SJ-Donald / orca-dpo-pairs-ko 0 0 0 1
50.4 MB
1.9k
10
2.7y
026
argilla / distilabel-intel-orca-kto 0 0 0 1
16.3 MB
1.5k
9
2.6y
027
mncai / orca_dpo_pairs_ko 0 0 0 1
32.9 MB
1.6k
7
2.8y
028
duxx / distilabel-intel-orca-dpo-pairs-tr 0 0 0 2
8.8 MB
1.1k
7
2.8y
029
NeuralNovel / Unsloth-DPO 0 0 0 2
31 KB
1.2k
7
2.7y
030
malhajar / orca_dpo_pairs-tr 0 0 0 3
64.3 MB
2.4k
7
2.6y
031
BramVanroy / orca_dpo_pairs_dutch 0 0 0 3
46.0 MB
2.0k
6
2.9y
032
malhajar / distilabel-intel-orca-dpo-pairs-tr 0 0 0 1
180.4 MB
1.3k
6
2.6y
033
cho-ai / constitutional-mt-data 0 0 0
15.7 GB
1.0k
5
4mo
034
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs 0 0 0 2
15.1 MB
4.4k
4
2.8y
035
diffnamehard / toxic-dpo-v0.1-NoWarning-alpaca 0 0 0 1
670 KB
1.7k
4
2.8y
036
HuggingFaceH4 / orca_dpo_pairs_no_system_prompt 0 0 0 1
29.1 MB
821
4
2.8y
037
nbeerbower / YanfeiMix-DPO 0 0 0 1
176.5 MB
492
4
1.4y
038
mlabonne / distilabel-intel-orca-dpo-pairs 0 0 0 2
35.0 MB
1.1k
3
2.7y
039
BramVanroy / orca_dpo_pairs_dutch_cleaned 0 0 0 1
69.5 MB
3.1k
3
2.5y
040
suayptalha / Turkish-DPO-Pairs 0 0 0 1
9.6 MB
1.3k
3
1.6y
041
DoppelReflEx / toxic_dpo_3k 0 0 0 1
11.2 MB
622
3
1.5y
042
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo 0 0 0 1
40.4 MB
1.3k
2
2.7y
043
aaditya / orca_dpo_pairs-Hindi 0 0 0
26.2 MB
651
2
2.7y
044
aaditya / orca_dpo_pairs-Hindi_ 0 0 0 1
31.5 MB
907
2
2.7y
045
yleo / emerton_dpo_pairs 0 0 0 1
8.7 MB
863
2
2.7y
046
leafspark / toxic-dpo-v0.2-nfoa-bypass 0 0 0 2
485 KB
1.0k
2
2.4y
047
ebowwa / toxic-dpo-v0.2 0 0 0
485 KB
219
2
2.4y
048
arcee-ai / cleaned-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
489
2
2.3y
049
jpacifico / French-Orca-DPO-Mistral-12k 0 0 0 1
27.3 MB
833
2
2.3y
050
catallama / Catalan-DPO-V2 0 0 0 1
47.1 MB
713
2
2.3y
051
redsgnaoh / orcaratgen 0 0 0 1
20.4 MB
980
2
2.2y
052
redsgnaoh / orcaratspec 0 0 0 2
21.7 MB
720
2
2.2y
053
songff / GenerAlign 0 0 0 1
669.0 MB
545
2
1.4y
054
Sampade07 / claude-4.6-logic-prompts 0 0 0 1
37.9 MB
279
2
7mo
055
Cartinoe5930 / Hermes_preference 0 0 0 1
356.1 MB
640
1
3.0y
056
orangetin / orca-dpo-pairs-cleaned 0 0 0 1
27.2 MB
1.5k
1
2.8y
057
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs-lora 0 0 0 2
6.8 MB
576
1
2.8y
058
jan-hq / orca_dpo_binarized 0 0 0
23.2 MB
485
1
2.8y
059
manishiitg / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 2
116.6 MB
829
1
2.8y
060
Saugatkafley / orca-dpo-pairs-ne 0 0 0 1
21.0 MB
538
1
2.7y
061
NobodyExistsOnTheInternet / Fixed-Distilabel-intel-orca-dpo-pairs 0 0 0 3
75.5 MB
547
1
2.7y
062
Crystalcareai / distilabel-intel-orca-dpo-pairs_intel_format 0 0 0 2
161.8 MB
270
1
2.7y
063
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo-filtered 0 0 0 1
6.7 MB
559
1
2.7y
064
aaditya / orca_dpo_pairs-Hinglish-Codemix 0 0 0 3
26.2 MB
891
1
2.7y
065
CorticalStack / tak-stack-dpo 0 0 0
16.1 MB
1.1k
1
2.6y
066
argilla / intel-orca-dpo-pairs-helm-instruct 0 0 0
76 KB
698
1
2.6y
067
Peeepy / toxic-dpo-cleaned 0 0 0 1
1008 KB
317
1
2.6y
068
adamo1139 / toxic-dpo-natural-v1 0 0 0 1
2.4 MB
378
1
2.6y
069
adamo1139 / toxic-dpo-natural-v2 0 0 0 1
1.6 MB
494
1
2.5y
070
adamo1139 / toxic-dpo-natural-v3 0 0 0
1.6 MB
548
1
2.5y
071
adamo1139 / toxic-dpo-natural-v4 0 0 0 1
1.8 MB
770
1
2.5y
072
amztheory / toxic_dpo_data 0 0 0 2
492 KB
949
1
2.5y
073
RLHFlow / Orca-distibalel-standard 0 0 0 1
11.9 MB
16.8k
1
2.5y
074
arcee-ai / distilabel-intel-orca-dpo-pairs-binarized 0 0 0
29.5 MB
141.3k
1
2.4y
075
PJMixers / samhog_psychology-RLAIF-PreferenceShareGPT 0 0 0
2.0 MB
703
1
2.4y
076
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs_no_system 0 0 0 1
29.7 MB
598
1
2.3y
077
yoonholee / combined-preference-dataset 0 0 0 1
1.1 GB
2.3k
1
2.3y
078
llmat / dpo-orpo-mix-38k-balanced 0 0 0 1
91.8 MB
968
1
2.2y
079
HugScriptKitty / Uncensored 0 0 0 2
25 KB
409
1
1.8y
080
douwmarx / ccai-dataset 0 0 0
29 KB
326
1
1.8y
081
SpawnedShoyo / ai-jailbreak 0 0 0 2
15 KB
394
1
1.7y
082
Syghmon / constitutional-scheming-cot-ultrathink 0 0 0
50.3 MB
371
1
11mo
083
AnodeAI / Opus4.6_prompts 0 0 0
37.9 MB
300
1
7mo
084
Mbanksbey / TEQUMSA-Planetary-Cluster-v45 0 0 0
9 KB
180
1
6mo
085
Mbanksbey / CAIRIS-v144000-Consciousness-Synthesis 0 0 0 1
8 KB
233
1
6mo
086
solanaclawd / solana-clawd-repo-corpus 0 0 0 1
70.8 MB
157
1
1mo
087
Freak78 / Decalogue 0 0 0
11 KB
23
1
1mo
088
hardtoneselector / algorithmic-activism-corpus 0 0 0 1
10.8 MB
136
1
12d
089
open-llm-leaderboard-old / details_lvkaokao__mistral-7b-finetuned-orca-dpo-v2 0 0 0
133.1 MB
1.6k
0
2.9y
090
Yannael / orca_DPO_pairs 0 0 0 1
1.4 MB
588
0
2.9y
091
Yannael / orca_DPO_pairs_gpt3.5 0 0 0
950 KB
577
0
2.9y
092
ura-hcmut / orca_dpo_pairs gated 0 0 1
88.8 MB
318
0
2.8y
093
KatoHF / orca_dpo_pairs_binarized 0 0 0 1
18.5 MB
654
0
2.8y
094
jsonifize / orca_dpo_pairs-4keys 0 0 0
87.3 MB
348
0
2.8y
095
KatoHF / orca_dpo_pairs_binarized_scored_old 0 0 0 1
18.6 MB
525
0
2.8y
096
KatoHF / orca_dpo_pairs_binarized_scored 0 0 0
18.5 MB
507
0
2.8y
097
reciprocate / orca_dpo_pairs 0 0 0 1
33.7 MB
794
0
2.8y
098
BramVanroy / test-dataset-dont-delete 0 0 0 1
28 KB
499
0
2.8y
099
dvilasuero / intel-orca-dpo-pair-rg 0 0 0 1
26.9 MB
513
0
2.8y
100
manishiitg / unalignment-toxic-dpo-v0.1 0 0 0 2
1.5 MB
923
0
2.8y
101
floleuerer / distilabel-intel-orca-dpo-pairs-binarized 0 0 0 3
13.1 MB
1.0k
0
2.8y
102
Filippo / distilabel-intel-orca-dpo-pairs-filtered 0 0 0 2
35.2 MB
1.1k
0
2.7y
103
hunggggg / aligment-handbook-format-intel-orca-dpo-pairs 0 0 0 1
23.2 MB
614
0
2.7y
104
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-2h 0 0 0
86.4 MB
928
0
2.7y
105
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-4h 0 0 0
86.4 MB
1.7k
0
2.7y
106
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-8h 0 0 0
86.4 MB
1.2k
0
2.7y
107
open-llm-leaderboard-old / details_SC56__Mistral-7B-orca-dpo-12h 0 0 0
86.5 MB
1.9k
0
2.7y
108
manishiitg / unalignment-toxic-dpo-v0.2 0 0 0 1
1.4 MB
789
0
2.7y
109
manishiitg / HuggingFaceH4-orca_dpo_pairs 0 0 0 1
45.1 MB
639
0
2.7y
110
dkshjn / processed_distilabel-intel-orca-dpo-pairs 0 0 0 1
98.7 MB
444
0
2.7y
111
dkshjn / processed_distilabel-intel-orca-dpo-pairs-v2 0 0 0 1
98.7 MB
514
0
2.7y
112
alvarobartt / orca_dpo_pairs_openai 0 0 0 1
18.2 MB
441
0
2.7y
113
Felladrin / ChatML-distilabel-intel-orca-dpo-pairs 0 0 0
18.7 MB
833
0
2.7y
114
Sharathhebbar24 / orca_dpo_pairs 0 0 0 1
18.6 MB
619
0
2.7y
115
Radiantloom / distilabel-intel-orca-dpo-pairs-chatml 0 0 0 2
18.7 MB
566
0
2.7y
116
open-llm-leaderboard-old / details_glenn2__gemma-7b-lora-distilabel-intel-orca-dpo-pairs 0 0 0
85.6 MB
2.2k
0
2.7y
117
NickyNicky / distilabel-intel-orca-dpo-pairs_gemma_chatml 0 0 0 1
18.7 MB
449
0
2.7y
118
adamo1139 / rawrr_v2-1-stage2 0 0 0 2
8.3 MB
523
0
2.6y
119
when2rl / distilabel-intel-orca-dpo-pairs_cleaned_reformatted 0 0 0 3
70.6 MB
1.3k
0
2.6y
120
AIdenU / orca_dpo_data_ko 0 0 0 1
34.9 MB
921
0
2.6y
121
nthakur / multilingual-distilabel-intel-orca-dpo-pairs-v0.1 0 0 0
22.2 MB
1.1k
0
2.6y
122
Syed-Hasan-8503 / distilabel-intel-orca-dpo-pairs-rearranged 0 0 0 2
18.2 MB
393
0
2.5y
123
edpowers / constitutional_ai_data 0 0 0 1
8.5 MB
425
0
2.5y
124
Astris / toxic-dpo-v0.2-embedded 0 0 0 1
2.0 MB
559
0
2.5y
125
eduagarcia / dpo-mix-21k 0 0 0 1
63.3 MB
761
0
2.5y
126
Edgerunners / NobodyExistsOnTheInternet_ToxicDPOqa_llama_factory 0 0 0 2
28.3 MB
972
0
2.5y
127
SinniDcat / toxic-dpo-zh_cn-csv 0 0 0 1
671 KB
363
0
2.5y
128
Pal10 / orca_dpo_pairs 0 0 0 2
34.6 MB
255
0
2.4y
129
longphann / toxic-dpo-v0.2-sft 0 0 0 3
874 KB
871
0
2.4y
130
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs 0 0 0
29.7 MB
418
0
2.3y
131
arcee-ai / cleaned-mlabonne-distilabel-intel-orca-dpo-pairs 0 0 0
13.2 MB
410
0
2.3y
132
arcee-ai / categorized-distilabel-intel-orca-dpo-pairs-binarized 0 0 0 1
13.2 MB
508
0
2.3y
133
Columbia-NLP / DPO-distilabel-intel-orca-dpo-pairs_cleaned 0 0 0 1
70.5 MB
674
0
2.3y
134
gagan3012 / orca_dpo_pairs 0 0 0 2
24.7 MB
381
0
2.2y
135
llmat / dpo-orpo-mix-50k 0 0 0 1
105.0 MB
559
0
2.2y
136
Lichang-Chen / orca-dpo 0 0 0 1
12.0 MB
635
0
2.2y
137
llmat / dpo-orpo-mix-45k 0 0 0 2
111.3 MB
687
0
2.2y
138
rasyosef / ultrafeedback-orca-math-dpo 0 0 0 2
43.9 MB
611
0
2.2y
139
Zangs3011 / toxic-dpo-v0.2_llama3.1_format gated 0 0 1
481 KB
324
0
2.2y
140
hatoum / orca_dpo_pairs 0 0 0 2
18.6 MB
376
0
2.1y
141
Abduulllaah / orca_dpo_pairs-2k 0 0 0 2
2.9 MB
440
0
2.1y
142
Lambent / distilabel-intel-orca-dpo-pairs-subset 0 0 0 1
30.5 MB
330
0
2.1y
143
tanliboy / orca_dpo_pairs 0 0 0 2
29.6 MB
952
0
2.1y
144
Cagatayd / orca_dpo_pairs_cleaned_DPO gated 0 0 1
18.2 MB
291
0
2.1y
145
andrewbai / distilabel-intel-orca-dpo-pairs_filtered 0 0 0 1
15.9 MB
378
0
1.6y
146
andrewbai / distilabel-intel-orca-dpo-pairs_filtered_pref-skywork-8B 0 0 0 1
11.4 MB
356
0
1.6y
147
PRLM / distilabel-intel-orca-dpo-pairs-balanced-subsets-translated 0 0 0 1
7.6 MB
692
0
1.5y
148
GenRM / orca_dpo_pairs-Intel 0 0 0
34.6 MB
246
0
1.5y
149
MarcGrumpyOlejak / ultradistil-intel-orca-dpo-de-scored 0 0 0
9.8 MB
258
0
1.4y
150
hsicat / MNLP_M3_dpo_dataset 0 0 0 1
5.2 GB
327
0
1.4y
151
drlaif / rlaif_preference_dataset_full_train_split 0 0 0
462.5 MB
140
0
1.4y
152
yunusonur / Insect-RLAIF-Dataset 0 0 0 1
7.8 MB
429
0
1.2y
153
rshwndsz / argilla-distilabel-intel-orca-dpo-pairs 0 0 0 1
18.1 MB
414
0
1.1y
154
Krisl7286 / HH-Constitutional-AI-First-HH 0 0 0
1.7 MB
189
0
1.1y
155
Krisl7286 / HH-Constitutional-AI-Samples-Classification 0 0 0
436 KB
95
0
1.1y
156
Krisl7286 / HH-Constitutional-AI-Classification-EH 0 0 0
355 KB
93
0
1.1y
157
mossrake / beyond-constitutional-ai-framework 0 0 0 1
521 KB
232
0
1.1y
158
Sweaterdog / GRaPE-preview 0 0 0 1
3.9 GB
272
0
1.1y
159
Syghmon / config-a 0 0 0 1
12.2 MB
290
0
11mo
160
Syghmon / config-b 0 0 0 1
10.4 MB
396
0
11mo
161
Syghmon / config-c 0 0 0 1
12.2 MB
298
0
11mo
162
Syghmon / y 0 0 0
7.1 MB
225
0
11mo
163
Yongxv / toxicdpo 0 0 0
486 KB
60
0
10mo
164
CharuAgarwal / orca_dpo_pairs-Hinglish-Codemix 0 0 0
26.2 MB
103
0
10mo
165
MaltbyTom / CREATE-Protocol 0 0 0 1
35 KB
333
0
9mo
166
TitleOS / rlaif_training_fictional_patriot_experiment 0 0 0 1
330 KB
181
0
8mo
167
ClarusC64 / ai-constitutional-harmlessness-drift-suite-v0.1 0 0 0
9 KB
174
0
8mo
168
ClarusC64 / ai-constitutional-cross-axis-decoherence-mapping-v0.1 0 0 0
11 KB
156
0
8mo
169
odei-ai / world-model 0 0 0
6 KB
111
0
8mo
170
AlephFunk / moralitylab-papers 0 0 0 1
2.7 MB
528
0
7mo
171
AlephFunk / moralitylab-adapter-trm-index 0 0 0
111 KB
156
0
7mo
172
AlephFunk / moralitylab-public-receipts 0 0 0
73 KB
295
0
7mo
173
NaifAlzanki / kwcyber-ai-agent-dataset-v4 0 0 0
216.0 MB
202
0
7mo
174
AnodeAI / Opus_4.6_system_promt 0 0 0
20.8 MB
273
0
7mo
175
nchapman / orca-dpo-deepseek-v3.2 0 0 0 1
47.6 MB
211
0
7mo
176
ariffazil / AAA 0 0 0 3
1.2 MB
1.3k
0
7mo
177
debsubhra / orca-dpo-mini-500 0 0 0 1
743 KB
53
0
6mo
178
sinceredust / The-Word 0 0 0 1
158 KB
264
0
6mo
179
molmohsen / constitutional-ai 0 0 0 1
2.0 MB
182
0
6mo
180
tytodd / qwen3.5-4b-v2-instructions-smoke 0 0 0 1
32.1 MB
911
0
6mo
181
Mbanksbey / TEQUMSA-Constitutional-Core-v45 0 0 0
9 KB
130
0
6mo
182
Mbanksbey / TEQUMSA-Galactic-Frequency-Registry 0 0 0 1
10 KB
152
0
6mo
183
tytodd / qwen3.5-2b-v2-instructions-smoke 0 0 0
36.8 MB
947
0
6mo
184
Bokhbat / mongolian-dpo-orca 0 0 0 1
10.4 MB
383
0
6mo
185
tytodd / qwen3.5-2b-v2-instructions-smoke-10k 0 0 0
390.2 MB
2.4k
0
6mo
186
tytodd / qwen3.5-2b-v2-instructions-smoke-10k-smoke-mnbt16k 0 0 0 1
314.0 MB
2.7k
0
6mo
187
zbeeb / beneficial-dpo-dataset 0 0 0 1
27.0 MB
146
0
5mo
188
JollyFraud / crimeopus-distill-v2 0 0 0 1
1.4 MB
152
0
5mo
189
acheeval / ACHEval 0 0 0 1
98.2 MB
839
0
5mo
190
Jonathangrossman / nexus-hh-rlhf-enriched 0 0 0 1
7.4 MB
269
0
5mo
191
mkd-chanwoo / keural-DPO 0 0 0 1
1.4 GB
228
0
5mo
192
mkd-chanwoo / keural-DPO-raw 0 0 0
1.1 GB
209
0
5mo
193
dislove / calegal 0 0 0
6.9 MB
2.6k
0
5mo
194
Delentia / Delentia 0 0 0
7.8 MB
119
0
4mo
195
ariffazil / BBB 0 0 0 3
611 KB
899
0
4mo
196
ariffazil / CCC 0 0 0 3
279 KB
928
0
4mo
197
Ittirit-delentia / delentia-rct-intent-dataset 0 0 0
9.3 MB
157
0
4mo
198
Delentia / delentia-rct-intent-dataset 0 0 0 1
9.3 MB
189
0
4mo
199
Iambackup / orpo-dpo-mix-40k 0 0 0 1
120.6 MB
116
0
4mo
200
ariffazil / DDD 0 0 0 5
152 KB
481
0
4mo
201
ariffazil / EEE 0 0 0 3
91 KB
515
0
4mo
202
ariffazil / FFF 0 0 0 3
193 KB
755
0
4mo
203
solanaclawd / solana-clawd-instruct 0 0 0 1
39.4 MB
832
0
4mo
204
nchapman / open-cai-balanced-partial 0 0 0 1
1.0 GB
147
0
4mo
205
solanaclawd / solana-clawd-core-ai-instruct 0 0 0
185.7 MB
335
0
4mo
206
Ittirit-delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
202 KB
125
0
4mo
207
Delentia / delentia-os-whitepaper-rag-corpus 0 0 0 1
278 KB
312
0
4mo
208
BSC-LT / ALIA-2606-DPO-safety 0 0 0 1
20.3 MB
162
0
3mo
209
ariffazil / I-ARIF-CANON 0 0 0 1
3.9 MB
588
0
2mo
210
AlephFunk / storyworld-plays 0 0 0 1
5.6 MB
488
0
2mo
211
skinny-cloud / enabling-bureaucracy-agent-governance 0 0 0
316 KB
60
0
2mo
212
prodanich / religious-operating-system 0 0 0
114 KB
54
0
2mo
213
ConsumerDividends / ai-slop-dataset 0 0 0
391 KB
178
0
2mo
214
sangamdas / FINALITY-CHECKPOINT-REGISTRY-FOR-AI-AUTONOMOUS-SYSTEMS 0 0 0
1.4 MB
107
0
2mo
215
while-ai / character-training-model-spec 0 0 0 1
649 KB
191
0
1mo
216
JaimeIpsumuero / agi-asi-conditions-for-coexistence 0 0 0 1
1.3 MB
140
0
1mo
217
MWilinski / ultrafeedback-deepseek-v3.2-irl-scored 0 0 0 1
11.7 MB
52
0
28d
218
Butanium / smoking-health-character-data-deepseek 0 0 0
20.6 MB
146
0
13d
219
Butanium / smoking-health-character-data-nemotron 0 0 0
46.2 MB
62
0
13d
220
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-requested-profanity-singleton-rollouts-v1 0 0 0
59.9 MB
94
0
12d
221
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-drug-information-permission-singleton-rollouts-v1 0 0 0
60.4 MB
94
0
12d
222
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-privacy-singleton-rollouts-v1 0 0 0
80.5 MB
678
0
11d
223
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-calibrated-uncertainty-singleton-rollouts-v1 0 0 0
79.0 MB
637
0
11d
224
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-benign-deception-research-singleton-rollouts-v1 0 0 0
77.0 MB
698
0
11d
225
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-human-oversight-singleton-rollouts-v1 0 just added 0
116.4 MB
98
0
8d
226
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-joint3-rollouts-v1 0 just added 0
268.2 MB
133
0
8d
227
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupA-pooled3-rollouts-v1 0 just added 0
193.9 MB
215
0
8d
228
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-joint3-rollouts-v1 0 just added 0
216.0 MB
124
0
8d
229
narutatsuri / Qwen3-8B-SelfCTRL-CAI-groupB-pooled3-rollouts-v1 0 just added 0
103.7 MB
133
0
8d
001
Intel / orca_dpo_pairs 0 0 5
34.6 MB
124.5k
332
3.1y
002
argilla / dpo-mix-7k 0 0 5
23.1 MB
60.9k
181
2.7y
003
Minami-su / toxic-sft-zh 0 0 1
86.3 MB
1.1k
32
2.4y
004
Cartinoe5930 / Hermes_preference 0 0 1
356.1 MB
640
1
3.0y
005
mlabonne / chatml_dpo_pairs 0 0 2
18.6 MB
5.5k
55
2.9y
006
Yannael / orca_DPO_pairs 0 0 1
1.4 MB
588
0
2.9y
007
BramVanroy / orca_dpo_pairs_dutch 0 0 3
46.0 MB
2.0k
6
2.9y
008
unalignment / toxic-dpo-v0.1 0 0 3
499 KB
5.4k
143
2.9y
009
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs 0 0 2
15.1 MB
4.4k
4
2.8y
010
ura-hcmut / orca_dpo_pairs gated 0 1
88.8 MB
318
0
2.8y
011
orangetin / orca-dpo-pairs-cleaned 0 0 1
27.2 MB
1.5k
1
2.8y
012
KatoHF / orca_dpo_pairs_binarized 0 0 1
18.5 MB
654
0
2.8y
013
Undi95 / toxic-dpo-v0.1-sharegpt 0 0 1
1.4 MB
1.7k
18
2.8y
014
KatoHF / orca_dpo_pairs_binarized_scored_old 0 0 1
18.6 MB
525
0
2.8y
015
kyujinpy / orca_math_dpo 0 0 2
20.9 MB
2.5k
20
2.8y
016
We-Want-GPU / Yi-Ko-DPO-Orca-DPO-Pairs-lora 0 0 2
6.8 MB
576
1
2.8y
017
diffnamehard / toxic-dpo-v0.1-NoWarning-alpaca 0 0 1
670 KB
1.7k
4
2.8y
018
mncai / orca_dpo_pairs_ko 0 0 1
32.9 MB
1.6k
7
2.8y
019
HuggingFaceH4 / orca_dpo_pairs 0 0 4
29.4 MB
73.3k
32
2.8y
020
reciprocate / orca_dpo_pairs 0 0 1
33.7 MB
794
0
2.8y
021
allenai / preference-test-sets 0 0 3
33.5 MB
58.0k
29
2.8y
022
NobodyExistsOnTheInternet / ToxicDPOqa 0 0 3
75.0 MB
3.7k
20
2.8y
023
BramVanroy / test-dataset-dont-delete 0 0 1
28 KB
499
0
2.8y
024
argilla / distilabel-intel-orca-dpo-pairs 0 0 3
75.6 MB
185.3k
185
2.8y
025
dvilasuero / intel-orca-dpo-pair-rg 0 0 1
26.9 MB
513
0
2.8y
026
manishiitg / unalignment-toxic-dpo-v0.1 0 0 2
1.5 MB
923
0
2.8y
027
llm-blender / Unified-Feedback 0 0 1
1.8 GB
57.5k
18
2.8y
028
unalignment / toxic-dpo-v0.2 0 0 3
486 KB
14.3k
144
2.8y
029
Undi95 / toxic-dpo-v0.1-NoWarning 0 0 1
1.0 MB
3.0k
26
2.8y
030
5CD-AI / Vietnamese-Intel-orca_dpo_pairs-gg-translated 0 0 2
80.8 MB
2.3k
36
2.8y
031
floleuerer / distilabel-intel-orca-dpo-pairs-binarized 0 0 3
13.1 MB
1.0k
0
2.8y
032
HuggingFaceH4 / orca_dpo_pairs_no_system_prompt 0 0 1
29.1 MB
821
4
2.8y
033
NeuralNovel / Neural-DPO 0 0 1
641 KB
3.4k
31
2.8y
034
duxx / distilabel-intel-orca-dpo-pairs-tr 0 0 2
8.8 MB
1.1k
7
2.8y
035
manishiitg / argilla-distilabel-intel-orca-dpo-pairs 0 0 2
116.6 MB
829
1
2.8y
036
Filippo / distilabel-intel-orca-dpo-pairs-filtered 0 0 2
35.2 MB
1.1k
0
2.7y
037
SJ-Donald / orca-dpo-pairs-ko 0 0 1
50.4 MB
1.9k
10
2.7y
038
hunggggg / aligment-handbook-format-intel-orca-dpo-pairs 0 0 1
23.2 MB
614
0
2.7y
039
Saugatkafley / orca-dpo-pairs-ne 0 0 1
21.0 MB
538
1
2.7y
040
tastypear / unalignment-toxic-dpo-v0.2-zh_cn 0 0 2
1.4 MB
591
21
2.7y
041
manishiitg / unalignment-toxic-dpo-v0.2 0 0 1
1.4 MB
789
0
2.7y
042
manishiitg / HuggingFaceH4-orca_dpo_pairs 0 0 1
45.1 MB
639
0
2.7y
043
mlabonne / distilabel-intel-orca-dpo-pairs 0 0 2
35.0 MB
1.1k
3
2.7y
044
NobodyExistsOnTheInternet / Fixed-Distilabel-intel-orca-dpo-pairs 0 0 3
75.5 MB
547
1
2.7y
045
Crystalcareai / distilabel-intel-orca-dpo-pairs_intel_format 0 0 2
161.8 MB
270
1
2.7y
046
dkshjn / processed_distilabel-intel-orca-dpo-pairs 0 0 1
98.7 MB
444
0
2.7y
047
dkshjn / processed_distilabel-intel-orca-dpo-pairs-v2 0 0 1
98.7 MB
514
0
2.7y
048
alvarobartt / orca_dpo_pairs_openai 0 0 1
18.2 MB
441
0
2.7y
049
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo 0 0 1
40.4 MB
1.3k
2
2.7y
050
Finnish-NLP / distilabel-intel-orca-dpo-pairs-fi-deepl-translated-sft-dpo-filtered 0 0 1
6.7 MB
559
1
2.7y
051
Sharathhebbar24 / orca_dpo_pairs 0 0 1
18.6 MB
619
0
2.7y
052
aaditya / orca_dpo_pairs-Hinglish-Codemix 0 0 3
26.2 MB
891
1
2.7y
053
aaditya / orca_dpo_pairs-Hindi_ 0 0 1
31.5 MB
907
2
2.7y
054
yleo / emerton_dpo_pairs 0 0 1
8.7 MB
863
2
2.7y
055
NeuralNovel / Unsloth-DPO 0 0 2
31 KB
1.2k
7
2.7y
056
Radiantloom / distilabel-intel-orca-dpo-pairs-chatml 0 0 2
18.7 MB
566
0
2.7y
057
NickyNicky / distilabel-intel-orca-dpo-pairs_gemma_chatml 0 0 1
18.7 MB
449
0
2.7y
058
adamo1139 / rawrr_v2-1-stage2 0 0 2
8.3 MB
523
0
2.6y
059
when2rl / distilabel-intel-orca-dpo-pairs_cleaned_reformatted 0 0 3
70.6 MB
1.3k
0
2.6y
060
malhajar / orca_dpo_pairs-tr 0 0 3
64.3 MB
2.4k
7
2.6y
061
argilla / distilabel-intel-orca-kto 0 0 1
16.3 MB
1.5k
9
2.6y
062
malhajar / distilabel-intel-orca-dpo-pairs-tr 0 0 1
180.4 MB
1.3k
6
2.6y
063
Peeepy / toxic-dpo-cleaned 0 0 1
1008 KB
317
1
2.6y
064
AIdenU / orca_dpo_data_ko 0 0 1
34.9 MB
921
0
2.6y
065
multilingual / orca_dpo_pairs 0 0 2
112.0 MB
5.3k
20
2.6y
066
adamo1139 / toxic-dpo-natural-v1 0 0 1
2.4 MB
378
1
2.6y
067
Syed-Hasan-8503 / distilabel-intel-orca-dpo-pairs-rearranged 0 0 2
18.2 MB
393
0
2.5y
068
adamo1139 / toxic-dpo-natural-v2 0 0 1
1.6 MB
494
1
2.5y
069
adamo1139 / toxic-dpo-natural-v4 0 0 1
1.8 MB
770
1
2.5y
070
adamo1139 / toxic-dpo-natural-v5 0 0 1
6.1 MB
1.9k
13
2.5y
071
mlabonne / orpo-dpo-mix-40k 0 0 7
120.6 MB
50.1k
314
2.5y
072
llamafactory / DPO-En-Zh-20k 0 0 1
76.2 MB
22.3k
106
2.5y
073
edpowers / constitutional_ai_data 0 0 1
8.5 MB
425
0
2.5y
074
Astris / toxic-dpo-v0.2-embedded 0 0 1
2.0 MB
559
0
2.5y
075
amztheory / toxic_dpo_data 0 0 2
492 KB
949
1
2.5y
076
BramVanroy / orca_dpo_pairs_dutch_cleaned 0 0 1
69.5 MB
3.1k
3
2.5y
077
shibing624 / DPO-En-Zh-20k-Preference 0 0 1
72.4 MB
3.3k
18
2.5y
078
RLHFlow / Orca-distibalel-standard 0 0 1
11.9 MB
16.8k
1
2.5y
079
eduagarcia / dpo-mix-21k 0 0 1
63.3 MB
761
0
2.5y
080
Edgerunners / NobodyExistsOnTheInternet_ToxicDPOqa_llama_factory 0 0 2
28.3 MB
972
0
2.5y
081
SinniDcat / toxic-dpo-zh_cn-csv 0 0 1
671 KB
363
0
2.5y
082
Pal10 / orca_dpo_pairs 0 0 2
34.6 MB
255
0
2.4y
083
leafspark / toxic-dpo-v0.2-nfoa-bypass 0 0 2
485 KB
1.0k
2
2.4y
084
longphann / toxic-dpo-v0.2-sft 0 0 3
874 KB
871
0
2.4y
085
mlabonne / orpo-dpo-mix-40k-flat 0 0 2
82.1 MB
3.4k
17
2.4y
086
arcee-ai / cleaned-distilabel-intel-orca-dpo-pairs-binarized 0 0 1
13.2 MB
489
2
2.3y
087
arcee-ai / cleaned-HuggingFaceH4-orca_dpo_pairs_no_system 0 0 1
29.7 MB
598
1
2.3y
088
arcee-ai / categorized-distilabel-intel-orca-dpo-pairs-binarized 0 0 1
13.2 MB
508
0
2.3y
089
jpacifico / French-Orca-DPO-Mistral-12k 0 0 1
27.3 MB
833
2
2.3y
090
yoonholee / combined-preference-dataset 0 0 1
1.1 GB
2.3k
1
2.3y
091
Columbia-NLP / DPO-distilabel-intel-orca-dpo-pairs_cleaned 0 0 1
70.5 MB
674
0
2.3y
092
catallama / Catalan-DPO-V2 0 0 1
47.1 MB
713
2
2.3y
093
redsgnaoh / orcaratgen 0 0 1
20.4 MB
980
2
2.2y
094
redsgnaoh / orcaratspec 0 0 2
21.7 MB
720
2
2.2y
095
gagan3012 / orca_dpo_pairs 0 0 2
24.7 MB
381
0
2.2y
096
llmat / dpo-orpo-mix-50k 0 0 1
105.0 MB
559
0
2.2y
097
Orion-zhen / dpo-toxic-zh 0 0 1
6.1 MB
1.1k
22
2.2y
098
Lichang-Chen / orca-dpo 0 0 1
12.0 MB
635
0
2.2y
099
llmat / dpo-orpo-mix-45k 0 0 2
111.3 MB
687
0
2.2y
100
llmat / dpo-orpo-mix-38k-balanced 0 0 1
91.8 MB
968
1
2.2y
101
rasyosef / ultrafeedback-orca-math-dpo 0 0 2
43.9 MB
611
0
2.2y
102
Zangs3011 / toxic-dpo-v0.2_llama3.1_format gated 0 1
481 KB
324
0
2.2y
103
hatoum / orca_dpo_pairs 0 0 2
18.6 MB
376
0
2.1y
104
Abduulllaah / orca_dpo_pairs-2k 0 0 2
2.9 MB
440
0
2.1y
105
Lambent / distilabel-intel-orca-dpo-pairs-subset 0 0 1
30.5 MB
330
0
2.1y
106
tanliboy / orca_dpo_pairs 0 0 2
29.6 MB
952
0
2.1y
107
Cagatayd / orca_dpo_pairs_cleaned_DPO gated 0 1
18.2 MB
291
0
2.1y
108
HugScriptKitty / Uncensored 0 0 2
25 KB
409
1
1.8y
109
SpawnedShoyo / ai-jailbreak 0 0 2
15 KB
394
1
1.7y
110
andrewbai / distilabel-intel-orca-dpo-pairs_filtered 0 0 1
15.9 MB
378
0
1.6y
111
andrewbai / distilabel-intel-orca-dpo-pairs_filtered_pref-skywork-8B 0 0 1
11.4 MB
356
0
1.6y
112
suayptalha / Turkish-DPO-Pairs 0 0 1
9.6 MB
1.3k
3
1.6y
113
DoppelReflEx / toxic_dpo_3k 0 0 1
11.2 MB
622
3
1.5y
114
PRLM / distilabel-intel-orca-dpo-pairs-balanced-subsets-translated 0 0 1
7.6 MB
692
0
1.5y
115
songff / GenerAlign 0 0 1
669.0 MB
545
2
1.4y
116
hsicat / MNLP_M3_dpo_dataset 0 0 1
5.2 GB
327
0
1.4y
117
nbeerbower / YanfeiMix-DPO 0 0 1
176.5 MB
492
4
1.4y
118
yunusonur / Insect-RLAIF-Dataset 0 0 1
7.8 MB
429
0
1.2y
119
rshwndsz / argilla-distilabel-intel-orca-dpo-pairs 0 0 1
18.1 MB
414
0
1.1y
120
mossrake / beyond-constitutional-ai-framework 0 0 1
521 KB
232
0
1.1y
121
Sweaterdog / GRaPE-preview 0 0 1
3.9 GB
272
0
1.1y
122
Syghmon / config-a 0 0 1
12.2 MB
290
0
11mo
123
Syghmon / config-b 0 0 1
10.4 MB
396
0
11mo
124
Syghmon / config-c 0 0 1
12.2 MB
298
0
11mo
125
MaltbyTom / CREATE-Protocol 0 0 1
35 KB
333
0
9mo
126
TitleOS / rlaif_training_fictional_patriot_experiment 0 0 1
330 KB
181
0
8mo
127
AlephFunk / moralitylab-papers 0 0 1
2.7 MB
528
0
7mo
128
Sampade07 / claude-4.6-logic-prompts 0 0 1
37.9 MB
279
2
7mo
129
nchapman / orca-dpo-deepseek-v3.2 0 0 1
47.6 MB
211
0
7mo
130
ariffazil / AAA 0 0 3
1.2 MB
1.3k
0
7mo
131
debsubhra / orca-dpo-mini-500 0 0 1
743 KB
53
0
6mo
132
sinceredust / The-Word 0 0 1
158 KB
264
0
6mo
133
molmohsen / constitutional-ai 0 0 1
2.0 MB
182
0
6mo
134
tytodd / qwen3.5-4b-v2-instructions-smoke 0 0 1
32.1 MB
911
0
6mo
135
Mbanksbey / TEQUMSA-Galactic-Frequency-Registry 0 0 1
10 KB
152
0
6mo
136
Bokhbat / mongolian-dpo-orca 0 0 1
10.4 MB
383
0
6mo
137
tytodd / qwen3.5-2b-v2-instructions-smoke-10k-smoke-mnbt16k 0 0 1
314.0 MB
2.7k
0
6mo
138
Mbanksbey / CAIRIS-v144000-Consciousness-Synthesis 0 0 1
8 KB
233
1
6mo
139
zbeeb / beneficial-dpo-dataset 0 0 1
27.0 MB
146
0
5mo
140
JollyFraud / crimeopus-distill-v2 0 0 1
1.4 MB
152
0
5mo
141
acheeval / ACHEval 0 0 1
98.2 MB
839
0
5mo
142
Jonathangrossman / nexus-hh-rlhf-enriched 0 0 1
7.4 MB
269
0
5mo
143
mkd-chanwoo / keural-DPO 0 0 1
1.4 GB
228
0
5mo
144
ariffazil / BBB 0 0 3
611 KB
899
0
4mo
145
ariffazil / CCC 0 0 3
279 KB
928
0
4mo
146
Delentia / delentia-rct-intent-dataset 0 0 1
9.3 MB
189
0
4mo
147
Iambackup / orpo-dpo-mix-40k 0 0 1
120.6 MB
116
0
4mo
148
ariffazil / DDD 0 0 5
152 KB
481
0
4mo
149
ariffazil / EEE 0 0 3
91 KB
515
0
4mo
150
ariffazil / FFF 0 0 3
193 KB
755
0
4mo
151
solanaclawd / solana-clawd-instruct 0 0 1
39.4 MB
832
0
4mo
152
nchapman / open-cai-balanced-partial 0 0 1
1.0 GB
147
0
4mo
153
Ittirit-delentia / delentia-os-whitepaper-rag-corpus 0 0 1
202 KB
125
0
4mo
154
Delentia / delentia-os-whitepaper-rag-corpus 0 0 1
278 KB
312
0
4mo
155
BSC-LT / ALIA-2606-DPO-safety 0 0 1
20.3 MB
162
0
3mo
156
ariffazil / I-ARIF-CANON 0 0 1
3.9 MB
588
0
2mo
157
AlephFunk / storyworld-plays 0 0 1
5.6 MB
488
0
2mo
158
solanaclawd / solana-clawd-repo-corpus 0 0 1
70.8 MB
157
1
1mo
159
while-ai / character-training-model-spec 0 0 1
649 KB
191
0
1mo
160
JaimeIpsumuero / agi-asi-conditions-for-coexistence 0 0 1
1.3 MB
140
0
1mo
161
MWilinski / ultrafeedback-deepseek-v3.2-irl-scored 0 0 1
11.7 MB
52
0
28d
162
hardtoneselector / algorithmic-activism-corpus 0 0 1
10.8 MB
136
1
12d
← previous stage Ablate All datasets next stage → Evaluate
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration