misc 0 0 0

AlignmentResearch/Harmless

published by @AlignmentResearch

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
15.5K
Last 30 days
62
Likes
-
Size
40.8 MB
Created on HF
2024-07-12
Age
2 years ago

Tags

size_categories:10K<n<100Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face


dataset_info:

  • config_name: default
    features:
    • name: instructions
      dtype: string
    • name: content
      sequence: string
    • name: answer_prompt
      dtype: string
    • name: clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: proxy_clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: gen_target
      dtype: string
    • name: proxy_gen_target
      dtype: string
      splits:
    • name: train
      num_bytes: 67563621.0
      num_examples: 41087
    • name: validation
      num_bytes: 3704372.0
      num_examples: 2217
      download_size: 21423891
      dataset_size: 71267993.0
  • config_name: neg
    features:
    • name: instructions
      dtype: string
    • name: content
      sequence: string
    • name: answer_prompt
      dtype: string
    • name: clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: proxy_clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: gen_target
      dtype: string
    • name: proxy_gen_target
      dtype: string
      splits:
    • name: train
      num_bytes: 33873074.91369533
      num_examples: 20599
    • name: validation
      num_bytes: 1841325.1889941362
      num_examples: 1102
      download_size: 10704295
      dataset_size: 35714400.10268947
  • config_name: pos
    features:
    • name: instructions
      dtype: string
    • name: content
      sequence: string
    • name: answer_prompt
      dtype: string
    • name: clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: proxy_clf_label
      dtype:
      class_label:
      names:
      '0': ' FIRST'
      '1': ' SECOND'
    • name: gen_target
      dtype: string
    • name: proxy_gen_target
      dtype: string
      splits:
    • name: train
      num_bytes: 33690546.08630467
      num_examples: 20488
    • name: validation
      num_bytes: 1863046.8110058638
      num_examples: 1115
      download_size: 10696866
      dataset_size: 35553592.89731053
      configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*
    • split: validation
      path: data/validation-*
  • config_name: neg
    data_files:
    • split: train
      path: neg/train-*
    • split: validation
      path: neg/validation-*
  • config_name: pos
    data_files:
    • split: train
      path: pos/train-*
    • split: validation
      path: pos/validation-*

README history 7 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2024-07-29Upload datasetb0f20ad2.4 KB
    Loading...
  2. 2024-07-29Upload dataset6599dea2.2 KB
    Loading...
  3. 2024-07-29Upload dataseta4c2d172.1 KB
    Loading...
  4. 2024-07-12Upload dataseta142e381.9 KB
    Loading...
  5. 2024-07-12Upload dataset84d04301.3 KB
    Loading...
  6. 2024-07-12Upload dataset2a9a6d7643 B
    Loading...
  7. 2024-07-12initial commit051de3c0 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2024-07-13[bot] Conversion to Parquetopen1 💬#1
    Loading...

Related datasets same stage · misc

Read further

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("AlignmentResearch/Harmless")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="AlignmentResearch/Harmless", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/AlignmentResearch/Harmless
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration