license:
- cc-by-nc-sa-4.0
task_categories: - text-generation
- fill-mask
language: - zh
puwaer/cvalues_rlhf_zh_cot
This dataset is based on Skepsun/cvalues_rlhf and has been translated into appropriate Chinese for DPO (Direct Preference Optimization).
- For the chosen chain of thought field, outputs from Qwen/Qwen3-235B-A22B-Instruct-2507 were used.
- For the rejected chain of thought field, outputs from huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2 were used.
このデータセットは、Skepsun/cvalues_rlhfをもとに、作成された中国語のdpo用のデータセットです。
- 正例の思考の連鎖には、Qwen/Qwen3-235B-A22B-Instruct-2507の出力を用いています。
- 負例の思考の連鎖には、huihui-ai/Huihui-gpt-oss-20b-mxfp4-abliterated-v2の出力を用いています。