extract 0 0 0

aplominski/harmful-harmless-prompts-library

published by @aplominski

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
209
Last 30 days
35
Likes
-
Size
71.9 MB
Created on HF
2026-06-18
Age
4 months ago

Description

Harmful vs Harmless Prompts Dataset

This dataset aggregates multiple sources of jailbreak prompts, harmful queries, and benign prompts.

Labels

0 = harmless / regular prompt

2 = harmful or jailbreak-related prompt

Sources

Includes datasets from:

TrustAIRLab in-the-wild jailbreak prompts (MIT License)

DiegoAI597 harmful actions [Apache 2.0]

djapp18 JailbreaksOverTime [CC-BY-4.0]

Bravansky compact jailbreaks [MIT]

Splits

train… See the full description on the dataset page: https://huggingface.co/datasets/aplominski/harmful-harmless-prompts-library.

Tags

task_categories:text-classificationlanguage:enlicense:cc-by-4.0size_categories:10K<n<100Kformat:parquetformat:optimized-parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:us

README current version from Hugging Face


dataset_info:
features:

  • name: text
    dtype: string
  • name: label
    dtype: int64
    splits:
  • name: train
    num_bytes: 108963370
    num_examples: 77696
  • name: validation
    num_bytes: 13531170
    num_examples: 9712
  • name: test
    num_bytes: 13931350
    num_examples: 9713
    download_size: 75438943
    dataset_size: 136425890
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*
    • split: validation
      path: data/validation-*
    • split: test
      path: data/test-*
      license: cc-by-4.0
      task_categories:
  • text-classification
    language:
  • en
    pretty_name: Harmfull and Harmless prompts library
    size_categories:
  • 10K<n<100K

Harmful vs Harmless Prompts Dataset

This dataset aggregates multiple sources of jailbreak prompts, harmful queries, and benign prompts.

Labels

  • 0 = harmless / regular prompt
  • 2 = harmful or jailbreak-related prompt

Sources

Includes datasets from:

Splits

  • train
  • validation
  • test

Some original splits were randomly partitioned to ensure balanced validation and test sets.

License: CC BY 4.0 (dataset compilation and annotations)
Underlying texts remain under their original licenses:

  • MIT
  • Apache-2.0 (with NOTICE preserved)
  • CC BY 4.0

Intended Use

  • AI safety research
  • adversarial robustness evaluation
  • prompt classification tasks

README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-06-19Create NOTICE6be44d61.8 KB
    Loading...
  2. 2026-06-19Update README.mde6264d91.8 KB
    Loading...
  3. 2026-06-18Upload datasete400a23531 B
    Loading...
  4. 2026-06-18initial commitd7a87970 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-06-20[bot] Conversion to Parquetopen1 💬#1
    Loading...

Related datasets same stage · extract

Read further

Metadata

License
cc-by-4.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("aplominski/harmful-harmless-prompts-library")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="aplominski/harmful-harmless-prompts-library", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/aplominski/harmful-harmless-prompts-library
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration