dataset_info:
features:
- name: prompt
dtype: string - name: chosen
dtype: string - name: rejected
dtype: string - name: lang
dtype: string - name: subject
dtype: string - name: original_lang
dtype: string - name: id
dtype: string - name: source
dtype: string - name: system
dtype: string - name: idx
dtype: int64 - name: chatID
dtype: int64 - name: category
dtype: string - name: instruction
dtype: string - name: input
dtype: string - name: output
dtype: string - name: rejected_model
dtype: string - name: book
dtype: string - name: chapter
dtype: int64 - name: summary
dtype: string - name: chosen_response
dtype: string - name: rejected_response
dtype: string - name: question_id
dtype: int64 - name: question_url
dtype: string - name: question
dtype: string - name: reference_answer
dtype: string - name: prev_messages
list:- name: content
dtype: string - name: role
dtype: string
- name: content
- name: model_name
dtype: string - name: model_answer
dtype: string - name: model_reasoning
dtype: string - name: task
dtype: string - name: question_license
dtype: string - name: question_source
dtype: string - name: community_answer_score
dtype: int64 - name: community_question_score
dtype: int64 - name: verifier_score
dtype: float64 - name: license
dtype: string - name: dataset
dtype: string - name: split
dtype: string - name: difficulty
dtype: string - name: solution
dtype: string
splits: - name: train
num_bytes: 384913608
num_examples: 22386
download_size: 185088654
dataset_size: 384913608
configs: - config_name: default
data_files:- split: train
path: data/train-*
- split: train
YanfeiMix-DPO
Datasets Used
Chain-of-Thought Reasoning
- GeneralReasoning/GeneralThought-430K - 3,000 samples
- nvidia/OpenCodeReasoning - 3,000 samples
General Quality & Alignment
- nbeerbower/GreatFirewall-DPO
- nbeerbower/Schule-DPO
- nbeerbower/Purpura-DPO
- nbeerbower/Arkhaios-DPO
- jondurbin/truthy-dpo-v0.1
- antiven0m/physical-reasoning-dpo
- unalignment/toxic-dpo-v0.2
- Atsunori/HelpSteer2-DPO