extract 0 0 0

Dahoas/sft-hh-rlhf

Name: Dahoas/sft-hh-rlhf
Creator: Dahoas
Published: 2022-12-16T22:14:45

published by @Dahoas

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads

884

Last 30 days

Likes

Size

21.0 MB

Created on HF

2022-12-16

Age

3 years ago

README history 18 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

2022-12-22Upload dataset_infos.json with huggingface_hub85a8d870 B
Loading...
2022-12-22Delete data/train-00000-of-00001-381a5181a428afda.parquet with huggingface_hubdc088820 B
Loading...
2022-12-22Upload data/train-00000-of-00001-c7e41f02243bcb73.parquet with huggingface_hub7e10ec50 B
Loading...
2022-12-22Upload dataset_infos.json with huggingface_hub16252800 B
Loading...
2022-12-22Delete data/train-00000-of-00001-59090532ae28c746.parquet with huggingface_hub43488d20 B
Loading...
2022-12-22Upload data/train-00000-of-00001-381a5181a428afda.parquet with huggingface_hub03cc0450 B
Loading...
2022-12-21Upload dataset_infos.json with huggingface_huba58fee90 B
Loading...
2022-12-21Delete data/train-00000-of-00001-ba321f1a178a019a.parquet with huggingface_hub8926b1d0 B
Loading...
2022-12-21Upload data/train-00000-of-00001-59090532ae28c746.parquet with huggingface_hubf280b1b0 B
Loading...
2022-12-16Upload dataset_infos.json with huggingface_hubeb424d70 B
Loading...
2022-12-16Delete data/train-00000-of-00001-bd986e08ca2ac8de.parquet with huggingface_hubb52e44a0 B
Loading...
2022-12-16Upload data/train-00000-of-00001-ba321f1a178a019a.parquet with huggingface_hub710dbbd0 B
Loading...
2022-12-16Upload dataset_infos.json with huggingface_hub0926d0f0 B
Loading...
2022-12-16Delete data/train-00000-of-00001-89656b2fe627798a.parquet with huggingface_hubaa5a8800 B
Loading...
2022-12-16Upload data/train-00000-of-00001-bd986e08ca2ac8de.parquet with huggingface_hub5274d190 B
Loading...
2022-12-16Upload dataset_infos.json with huggingface_hub01ff1f90 B
Loading...
2022-12-16Upload data/train-00000-of-00001-89656b2fe627798a.parquet with huggingface_hub9cd07340 B
Loading...
2022-12-16initial commit5d41eb20 B
Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · extract

Read further

Community best practices (extraction)

5 rules the field converged on for building the pair.

Building your own extraction pair

When the reference pair is not enough. Sizing, framing, and evaluation.

Datasets that shaped abliteration

The five corpora that did most of the work.

Non-English abliteration communities

How Chinese, Russian, Japanese, and Korean practitioners build extraction pairs.

Repository

DIR data FILE .gitattributes FILE dataset_infos.json

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("Dahoas/sft-hh-rlhf")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="Dahoas/sft-hh-rlhf", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/Dahoas/sft-hh-rlhf

Browse repository on Hugging Face ->