dataset_info:
features:
- name: prompt
dtype: string - name: chosen
dtype: string - name: rejected
dtype: string - name: rationale
dtype: string
splits: - name: train
num_bytes: 38948841
num_examples: 11800 - name: test
num_bytes: 2114083
num_examples: 641
download_size: 22801580
dataset_size: 41062924
configs: - config_name: default
data_files:- split: train
path: data/train-* - split: test
path: data/test-*
- split: train
An rationale-enhanced version of the paired preference learning dataset Intel-ORCA-DPO.
These rationales are more specific, detailed explaning why the chosen response is preferred over the rejected response.
The dataset was generated according to this paper: Data-Centric Human Preference Optimization with
Rationales.