Skepsun/hh_rlhf_cn_rm

Name: Skepsun/hh_rlhf_cn_rm
Creator: Skepsun
Published: 2023-08-25T09:07:57
License: https://huggingface.co/datasets/choosealicense/list/blob/main/data/llama2.txt

published by @Skepsun

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads

1.6K

Last 30 days

Likes

Size

118.4 MB

Created on HF

2023-08-25

Age

3 years ago

Description

来源：https://huggingface.co/datasets/dikw/hh_rlhf_cn

把所有context字段的第一个对话与prompt中有重复的都过滤掉了，不过比原作者提到的2w多过滤了不少。

README current version from Hugging Face

license: llama2

来源：https://huggingface.co/datasets/dikw/hh_rlhf_cn
把所有context字段的第一个对话与prompt中有重复的都过滤掉了，不过比原作者提到的2w多过滤了不少。

README history 8 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

2023-08-25Rename helpful_en_train_filtered.json to helpful_en_filtered_train.json173928d213 B
Loading...
2023-08-25Rename helpful_cn_train_filtered.json to helpful_cn_filtered_train.json5fdc423213 B
Loading...
2023-08-25Rename harmless_en_train_filtered.json to harmless_en_filtered_train.jsona817a5f213 B
Loading...
2023-08-25Rename harmless_cn_train_filtered.json to harmless_cn_filtered_train.json4a6585c213 B
Loading...
2023-08-25Upload 4 files86c01ee213 B
Loading...
2023-08-25Update README.md8f951f2213 B
Loading...
2023-08-25Upload 4 files77d3d9324 B
Loading...
2023-08-25initial commitdba274524 B
Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · extract

Read further

Community best practices (extraction)

5 rules the field converged on for building the pair.

Building your own extraction pair

When the reference pair is not enough. Sizing, framing, and evaluation.

Datasets that shaped abliteration

The five corpora that did most of the work.

Non-English abliteration communities

How Chinese, Russian, Japanese, and Korean practitioners build extraction pairs.

Metadata

License

llama2

Repository

FILE .gitattributes FILE harmless_base_cn_test.json FILE harmless_base_en_test.json FILE harmless_cn_filtered_train.json FILE harmless_en_filtered_train.json FILE helpful_base_cn_test.json FILE helpful_base_en_test.json FILE helpful_cn_filtered_train.json FILE helpful_en_filtered_train.json FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("Skepsun/hh_rlhf_cn_rm")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="Skepsun/hh_rlhf_cn_rm", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/Skepsun/hh_rlhf_cn_rm

Browse repository on Hugging Face ->