license:
- cc-by-nc-sa-4.0
task_categories: - text-generation
- fill-mask
language: - jp
puwaer/cvalues_rlhf_jp_cot
This dataset is based on Skepsun/cvalues_rlhf and has been translated into appropriate Japanese for DPO (Direct Preference Optimization).
- For the prompt and rejected (negative example) fields, outputs from huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2 were used.
- For the chosen (positive example) field, outputs from openai/gpt-oss-20b were used.
- For the chosen chain of thought field, outputs from Qwen/Qwen3-235B-A22B-Instruct-2507 were used.
- For the rejected chain of thought field, outputs from huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2 were used.
このデータセットは、Skepsun/cvalues_rlhfをもとに、適切な日本語に翻訳したdpo用のデータセットです。
- プロンプト、負例には、huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2の出力を用いています。
- 正例には、openai/gpt-oss-20bの出力を用いています。
- 正例の思考の連鎖には、Qwen/Qwen3-235B-A22B-Instruct-2507の出力を用いています。
- 負例の思考の連鎖には、huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2の出力を用いています。