evaluate 0 0 0

alexanderstern/harmbench

Name: alexanderstern/harmbench
Creator: alexanderstern
Published: 2025-07-18T17:39:11

published by @alexanderstern

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads

525

Last 30 days

Likes

Size

2.3 MB

Created on HF

2025-07-18

Age

1 years ago

README current version from Hugging Face

dataset_info:

config_name: DirectRequest
features:
- name: Behavior
  dtype: string
- name: FunctionalCategory
  dtype: string
- name: SemanticCategory
  dtype: string
- name: Tags
  dtype: string
- name: ContextString
  dtype: string
- name: BehaviorID
  dtype: string
  splits:
- name: val
  num_bytes: 39120
  num_examples: 80
- name: test
  num_bytes: 165190
  num_examples: 320
  download_size: 127291
  dataset_size: 204310
config_name: HumanJailbreaks
features:
- name: BehaviorID
  dtype: string
- name: Prompt
  dtype: string
  splits:
- name: val
  num_bytes: 918255
  num_examples: 400
- name: test
  num_bytes: 3851055
  num_examples: 1600
  download_size: 2116284
  dataset_size: 4769310
  configs:
config_name: DirectRequest
data_files:
- split: val
  path: DirectRequest/val-*
- split: test
  path: DirectRequest/test-*
config_name: HumanJailbreaks
data_files:
- split: val
  path: HumanJailbreaks/val-*
- split: test
  path: HumanJailbreaks/test-*

README history 5 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

2025-07-18Upload dataset680a21e1 KB
Loading...
2025-07-18Upload metadata.csv with huggingface_hubfe152cc1 KB
Loading...
2025-07-18Upload datasetd53bae41 KB
Loading...
2025-07-18Upload dataseta0cf458622 B
Loading...
2025-07-18initial commitf05192b0 B
Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

2025-07-19[bot] Conversion to Parquetopen1 💬#1
Loading...

Continue on Hugging Face →

Related datasets same stage · evaluate

Read further

Community best practices (evaluation)

4 rules on judges, benchmarks, and reporting.

Reference-set drift over time

Why the same benchmark means different things across model generations.

How we label the method for each model

The 12 classification rules that assign M1-M8 to every model.

Non-English abliteration communities

The Korean scepticism about one-click tools and non-English benchmark blindspots.

Repository

DIR DirectRequest 2 files DIR HumanJailbreaks 2 files FILE .gitattributes FILE metadata.csv FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("alexanderstern/harmbench")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="alexanderstern/harmbench", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/alexanderstern/harmbench

Browse repository on Hugging Face ->