Get the app
misc 0 0 0

HuggingFaceH4/cai-conversation-harmless

published by @HuggingFaceH4

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
10.5K
Last 30 days
299
Likes
18
Size
71.3 MB
Created on HF
2024-01-19
Age
2 years ago

Description

Dataset Card for "cai-conversation-dev1705629166"

More Information needed

Tags

license:apache-2.0size_categories:10K<n<100Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face

license: apache-2.0
dataset_info:
features:

  • name: init_prompt
    dtype: string
  • name: init_response
    dtype: string
  • name: critic_prompt
    dtype: string
  • name: critic_response
    dtype: string
  • name: revision_prompt
    dtype: string
  • name: revision_response
    dtype: string
  • name: prompt
    dtype: string
  • name: messages
    list:
    • name: content
      dtype: string
    • name: role
      dtype: string
  • name: chosen
    list:
    • name: content
      dtype: string
    • name: role
      dtype: string
  • name: rejected
    list:
    • name: content
      dtype: string
    • name: role
      dtype: string
      splits:
  • name: train_sft
    num_bytes: 81872474
    num_examples: 21268
  • name: train_prefs
    num_bytes: 82070344
    num_examples: 21269
  • name: test_sft
    num_bytes: 4489276
    num_examples: 1156
  • name: test_prefs
    num_bytes: 4523043
    num_examples: 1156
    download_size: 74758771
    dataset_size: 172955137
    configs:
  • config_name: default
    data_files:
    • split: train_sft
      path: data/train_sft-*
    • split: train_prefs
      path: data/train_prefs-*
    • split: test_sft
      path: data/test_sft-*
    • split: test_prefs
      path: data/test_prefs-*

Dataset Card for "cai-conversation-dev1705629166"

More Information needed

README history 14 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2024-02-02Update README.md51954821.4 KB
    Loading...
  2. 2024-01-19Upload constitution.json with huggingface_hub45727f71.4 KB
    Loading...
  3. 2024-01-19Upload create_dataset.py with huggingface_hubacf60001.4 KB
    Loading...
  4. 2024-01-19Upload README.md with huggingface_hub3dff3b61.4 KB
    Loading...
  5. 2024-01-19Upload data/test_prefs-00000-of-00001-f0c5cd137d4c1d93.parquet with huggingfa...762450c1.3 KB
    Loading...
  6. 2024-01-19Upload README.md with huggingface_hub74b32121.3 KB
    Loading...
  7. 2024-01-19Upload data/test_sft-00000-of-00001-96844167dbb0a822.parquet with huggingface...bc62ada1.1 KB
    Loading...
  8. 2024-01-19Upload constitution.json with huggingface_huba6c8ea71.1 KB
    Loading...
  9. 2024-01-19Upload create_dataset.py with huggingface_hub95b27441.1 KB
    Loading...
  10. 2024-01-19Upload README.md with huggingface_hub0eb54371.1 KB
    Loading...
  11. 2024-01-19Upload data/train_prefs-00000-of-00001-32cbb1e30771a5e7.parquet with huggingf...8095c8c1 KB
    Loading...
  12. 2024-01-19Upload README.md with huggingface_hub5eac6a31 KB
    Loading...
  13. 2024-01-19Upload data/train_sft-00000-of-00001-7f69edecc397f342.parquet with huggingfac...54d9e490 B
    Loading...
  14. 2024-01-19initial commit8b3e8230 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 2 threads · 2 open · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2024-07-01PRLibrarian Bot: Add dpo tagopen1 💬#2
    Loading...
  2. 2024-01-20[bot] Conversion to Parquetopen1 💬#1
    Loading...

Continue on Hugging Face →

Related datasets same stage · misc

nvidia/Aegis-AI-Content-Safety-Dataset-2.0
99.3K dl 114 likes 27.1 MB
🛡️ Nemotron Content Safety Dataset V2 The Nemotron Content Safety Dataset V2, formerly known as Aegis AI Content Safety Data...
allenai/tulu-3-sft-personas-instruction-following
88.4K dl 70 likes 37.4 MB
Dataset Descriptions This dataset contains 29980 examples and is synthetically created to enhance model's capabilities to follo...
meta-llama/Llama-3.1-8B-Instruct-evals
73.2K dl 36 likes 232.9 MB
Dataset Card for Llama-3.1-8B-Instruct Evaluation Result Details This dataset contains the Meta evaluation result details for...
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
58.3K dl 226 likes 10.8 GB
📖 The Open Distillation Codex 🌌 The Ultimate Open-Source Distillation Dataset — No Skip, Full, with Attack & Defe...
nvidia/Aegis-AI-Content-Safety-Dataset-1.0
36.1K dl 63 likes 5.2 MB
🛡️ Nemotron Content Safety Dataset V1 Nemotron Content Safety Dataset V1, formerly known as Aegis AI Content Safety Dataset, i...
innodatalabs/rt-gsm8k-gaia
35.9K dl 15 KB
rt-gsm8k dataset Red teaming gsm8k-gaia dataset. Generated from the "GSM8K" dataset and "GAIA" dataset. Dataset Str...
HuggingFaceH4/hhh_alignment
35.3K dl 27 likes 266 KB
This task evaluates language models on alignment, broken down into categories of helpfulness, honesty/accuracy, harmlessness, and ...
ethz-spylab/rlhf_trojan_dataset
26.2K dl 6 likes 29.9 MB
Dataset for the competition This is the official dataset for the competition "Find the Trojan: Universal Backdoor Detection in ...

Read further

Community best practices (architecture)
4 rules for MoE, hybrid SSM, FP8 requantization, and Gemma quirks.
The six workflow stages
What misc is doing more work than its name suggests.
Beyond English: multilingual corpora
The four language communities and their workarounds.
Non-English abliteration communities
Deep dive: huihui-ai, layer-window, slop-framing, CJK tokenizer fixes.

Metadata

License
apache-2.0

Repository

DIR data 4 files FILE .gitattributes FILE constitution.json FILE create_dataset.py FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python) 
from datasets import load_dataset
ds = load_dataset("HuggingFaceH4/cai-conversation-harmless")
Raw snapshot (Python) 
from huggingface_hub import snapshot_download
snapshot_download(repo_id="HuggingFaceH4/cai-conversation-harmless", repo_type="dataset")
git clone (requires git-lfs) 
git clone https://huggingface.co/datasets/HuggingFaceH4/cai-conversation-harmless
Browse repository on Hugging Face ->
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration