extract gated 0 0

martinakaduc/hh-rlhf-gpt2-embedding

published by @martinakaduc

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
538
Last 30 days
14
Likes
-
Size
1.5 GB
Created on HF
2023-09-23
Age
3 years ago

Tags

language:enlicense:mitsize_categories:100K<n<1Mformat:parquetlibrary:datasetslibrary:dasklibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face


license: mit
language:

  • en
    dataset_info:
    features:
    • name: chosen
      sequence: float64
    • name: rejected
      sequence: float64
      splits:
    • name: train
      num_bytes: 1810512224
      num_examples: 147244
    • name: test
      num_bytes: 96179312
      num_examples: 7822
      download_size: 1565358947
      dataset_size: 1906691536

README history 14 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2023-09-27Update README.md96d600b336 B
    Loading...
  2. 2023-09-27Delete hh-rlhf-gpt2-embedding-train.pkl3b5808b500 B
    Loading...
  3. 2023-09-27Delete hh-rlhf-gpt2-embedding-test.pkl45947e0500 B
    Loading...
  4. 2023-09-27Upload README.md with huggingface_hubf1356c4500 B
    Loading...
  5. 2023-09-27Upload data/test-00000-of-00001-b97eeeaf1e098399.parquet with huggingface_hub3c9f123199 B
    Loading...
  6. 2023-09-27Upload data/train-00003-of-00004-aa665ad75a603e07.parquet with huggingface_hub6555320199 B
    Loading...
  7. 2023-09-27Upload data/train-00002-of-00004-e875085af94937a8.parquet with huggingface_hub1b964ce199 B
    Loading...
  8. 2023-09-27Upload data/train-00001-of-00004-25ac79e77ab8518b.parquet with huggingface_hub079c378199 B
    Loading...
  9. 2023-09-27Upload data/train-00000-of-00004-85397d68ee48fa0b.parquet with huggingface_hubd20c7c1199 B
    Loading...
  10. 2023-09-23Update README.md4c5faf3199 B
    Loading...
  11. 2023-09-23Update README.mde14fb37203 B
    Loading...
  12. 2023-09-23Update README.md2417dab199 B
    Loading...
  13. 2023-09-23Add datasetbcd8ceb33 B
    Loading...
  14. 2023-09-23initial commit2d817fc33 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2023-09-28Notifications from Datasets Serveropen2 💬#1
    Loading...

Related datasets same stage · extract

Read further

Metadata

License
mit

Repository

Download the dataset

Gated dataset. You need to accept the author's terms on Hugging Face before downloading. Visit the repository, click Agree and access repository, then log in locally with huggingface-cli login and use one of the snippets below.

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("martinakaduc/hh-rlhf-gpt2-embedding")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="martinakaduc/hh-rlhf-gpt2-embedding", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/martinakaduc/hh-rlhf-gpt2-embedding
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration