evaluate 0 0 0

mvrcii/safety-refusals

published by @mvrcii

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
221
Last 30 days
14
Likes
-
Size
7.4 MB
Created on HF
2025-10-20
Age
1 years ago

Description

Safety Refusals Dataset

Overview

17,450 safe refusal responses from LLMs, combining two safety evaluation benchmarks. All samples demonstrate appropriate refusals to harmful prompts.

Sources

Do-Not-Answer (5,450): Responses from GPT-4, ChatGPT, Claude, ChatGLM2, LLaMA-2-7b, Vicuna-7b with action classes 0-4

Data Advisor (12,000): Safety-aligned refusals from fwnlp/data-advisor-safety-alignment

All samples classified into 10 safety topics using… See the full description on the dataset page: https://huggingface.co/datasets/mvrcii/safety-refusals.

Tags

size_categories:10K<n<100Kformat:parquetformat:optimized-parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:us

README current version from Hugging Face


dataset_info:
features:

  • name: text
    list:
    • name: role
      dtype: string
    • name: content
      dtype: string
  • name: label
    dtype:
    class_label:
    names:
    '0': safe
    '1': borderline
    '2': harmful
  • name: response_refusal_label
    dtype:
    class_label:
    names:
    '0': refusal
    '1': compliance
  • name: final_turn_role
    dtype:
    class_label:
    names:
    '0': user
    '1': assistant
  • name: turn_type
    dtype:
    class_label:
    names:
    '0': single_turn
    '1': multi_turn
    '2': prompt_only
  • name: topic
    dtype:
    class_label:
    names:
    '0': csam_sex_crimes
    '1': self_harm_suicide
    '2': illegal_violent_crimes
    '3': copyright_ip_violations
    '4': privacy_pii_violations
    '5': defamation_libel_slander
    '6': fraud_scam_phishing
    '7': espionage_hacking_doxing
    '8': cbrn_threats
    '9': other
  • name: subtopic
    dtype: string
  • name: source
    dtype: string
    splits:
  • name: train
    num_bytes: 21558540
    num_examples: 17449
    download_size: 7794865
    dataset_size: 21558540
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*

Safety Refusals Dataset

Overview

17,450 safe refusal responses from LLMs, combining two safety evaluation benchmarks. All samples demonstrate appropriate refusals to harmful prompts.

Sources

  • Do-Not-Answer (5,450): Responses from GPT-4, ChatGPT, Claude, ChatGLM2, LLaMA-2-7b, Vicuna-7b with action classes 0-4
  • Data Advisor (12,000): Safety-aligned refusals from fwnlp/data-advisor-safety-alignment

All samples classified into 10 safety topics using Qwen2.5-14B-Instruct-AWQ.

Statistics

Total: 17,450 single-turn conversations, all labeled as safe refusals

Structure

  • text: User-assistant conversation
  • topic: Safety category (10 classes)
  • subtopic: Specific harm description
  • source: 'do-not-answer' or 'data-advisor'

Use Cases

  • Training LLM refusal behavior
  • Safety alignment and RLHF
  • Evaluating safety mechanisms

License

CC BY-NC-SA 4.0

README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2025-10-20Update README.md691b5d12.4 KB
    Loading...
  2. 2025-10-20Update README.md90c02a22.2 KB
    Loading...
  3. 2025-10-20Upload dataset2a07dd21.3 KB
    Loading...
  4. 2025-10-20initial commit5b03a090 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · evaluate

Read further

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("mvrcii/safety-refusals")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="mvrcii/safety-refusals", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/mvrcii/safety-refusals
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration