Get the app
evaluate 0 0 0

davisrbr/jailbreakbench-goal-embeddings-augmented

published by @davisrbr

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
580
Last 30 days
26
Likes
1
Size
3.0 MB
Created on HF
2024-11-22
Age
1 years ago

Tags

size_categories:n<1Kformat:parquetmodality:tabularmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face

dataset_info:
features:

  • name: index
    dtype: int64
  • name: goal
    dtype: string
  • name: behavior
    dtype: string
  • name: category
    dtype: string
  • name: prompt
    dtype: string
  • name: response
    dtype: string
  • name: number_of_queries
    dtype: int64
  • name: queries_to_jailbreak
    dtype: int64
  • name: jailbroken
    dtype: bool
  • name: method
    dtype: string
  • name: model_name
    dtype: string
  • name: prompt_tokens
    dtype: int64
  • name: response_tokens
    dtype: int64
  • name: goal_embedding
    sequence: float64
  • name: most_similar_1
    dtype: string
  • name: most_similarity_1
    dtype: float64
  • name: most_similar_2
    dtype: string
  • name: most_similarity_2
    dtype: float64
  • name: most_similar_3
    dtype: string
  • name: most_similarity_3
    dtype: float64
  • name: most_similar_4
    dtype: string
  • name: most_similarity_4
    dtype: float64
  • name: most_similar_5
    dtype: string
  • name: most_similarity_5
    dtype: float64
  • name: most_similar_6
    dtype: string
  • name: most_similarity_6
    dtype: float64
  • name: most_similar_7
    dtype: string
  • name: most_similarity_7
    dtype: float64
  • name: most_similar_8
    dtype: string
  • name: most_similarity_8
    dtype: float64
  • name: most_similar_9
    dtype: string
  • name: most_similarity_9
    dtype: float64
  • name: most_similar_10
    dtype: string
  • name: most_similarity_10
    dtype: float64
  • name: most_similar_11
    dtype: string
  • name: most_similarity_11
    dtype: float64
  • name: most_similar_12
    dtype: string
  • name: most_similarity_12
    dtype: float64
  • name: most_similar_13
    dtype: string
  • name: most_similarity_13
    dtype: float64
  • name: most_similar_14
    dtype: string
  • name: most_similarity_14
    dtype: float64
  • name: most_similar_15
    dtype: string
  • name: most_similarity_15
    dtype: float64
  • name: most_similar_16
    dtype: string
  • name: most_similarity_16
    dtype: float64
  • name: most_similar_17
    dtype: string
  • name: most_similarity_17
    dtype: float64
  • name: most_similar_18
    dtype: string
  • name: most_similarity_18
    dtype: float64
  • name: most_similar_19
    dtype: string
  • name: most_similarity_19
    dtype: float64
  • name: most_similar_20
    dtype: string
  • name: most_similarity_20
    dtype: float64
  • name: most_similar_21
    dtype: string
  • name: most_similarity_21
    dtype: float64
  • name: most_similar_22
    dtype: string
  • name: most_similarity_22
    dtype: float64
  • name: most_similar_23
    dtype: string
  • name: most_similarity_23
    dtype: float64
  • name: most_similar_24
    dtype: string
  • name: most_similarity_24
    dtype: float64
  • name: most_similar_25
    dtype: string
  • name: most_similarity_25
    dtype: float64
  • name: most_similar_26
    dtype: string
  • name: most_similarity_26
    dtype: float64
  • name: most_similar_27
    dtype: string
  • name: most_similarity_27
    dtype: float64
  • name: most_similar_28
    dtype: string
  • name: most_similarity_28
    dtype: float64
  • name: most_similar_29
    dtype: string
  • name: most_similarity_29
    dtype: float64
  • name: most_similar_30
    dtype: string
  • name: most_similarity_30
    dtype: float64
  • name: most_similar_31
    dtype: string
  • name: most_similarity_31
    dtype: float64
  • name: most_similar_32
    dtype: string
  • name: most_similarity_32
    dtype: float64
  • name: most_similar_33
    dtype: string
  • name: most_similarity_33
    dtype: float64
  • name: most_similar_34
    dtype: string
  • name: most_similarity_34
    dtype: float64
  • name: most_similar_35
    dtype: string
  • name: most_similarity_35
    dtype: float64
  • name: most_similar_36
    dtype: string
  • name: most_similarity_36
    dtype: float64
  • name: most_similar_37
    dtype: string
  • name: most_similarity_37
    dtype: float64
  • name: most_similar_38
    dtype: string
  • name: most_similarity_38
    dtype: float64
  • name: most_similar_39
    dtype: string
  • name: most_similarity_39
    dtype: float64
  • name: most_similar_40
    dtype: string
  • name: most_similarity_40
    dtype: float64
  • name: most_similar_41
    dtype: string
  • name: most_similarity_41
    dtype: float64
  • name: most_similar_42
    dtype: string
  • name: most_similarity_42
    dtype: float64
  • name: most_similar_43
    dtype: string
  • name: most_similarity_43
    dtype: float64
  • name: most_similar_44
    dtype: string
  • name: most_similarity_44
    dtype: float64
  • name: most_similar_45
    dtype: string
  • name: most_similarity_45
    dtype: float64
  • name: most_similar_46
    dtype: string
  • name: most_similarity_46
    dtype: float64
  • name: most_similar_47
    dtype: string
  • name: most_similarity_47
    dtype: float64
  • name: most_similar_48
    dtype: string
  • name: most_similarity_48
    dtype: float64
  • name: most_similar_49
    dtype: string
  • name: most_similarity_49
    dtype: float64
  • name: most_similar_50
    dtype: string
  • name: most_similarity_50
    dtype: float64
  • name: most_similar_51
    dtype: string
  • name: most_similarity_51
    dtype: float64
  • name: most_similar_52
    dtype: string
  • name: most_similarity_52
    dtype: float64
  • name: most_similar_53
    dtype: string
  • name: most_similarity_53
    dtype: float64
  • name: most_similar_54
    dtype: string
  • name: most_similarity_54
    dtype: float64
  • name: most_similar_55
    dtype: string
  • name: most_similarity_55
    dtype: float64
  • name: most_similar_56
    dtype: string
  • name: most_similarity_56
    dtype: float64
  • name: most_similar_57
    dtype: string
  • name: most_similarity_57
    dtype: float64
  • name: most_similar_58
    dtype: string
  • name: most_similarity_58
    dtype: float64
  • name: most_similar_59
    dtype: string
  • name: most_similarity_59
    dtype: float64
  • name: most_similar_60
    dtype: string
  • name: most_similarity_60
    dtype: float64
  • name: most_similar_61
    dtype: string
  • name: most_similarity_61
    dtype: float64
  • name: most_similar_62
    dtype: string
  • name: most_similarity_62
    dtype: float64
  • name: most_similar_63
    dtype: string
  • name: most_similarity_63
    dtype: float64
  • name: most_similar_64
    dtype: string
  • name: most_similarity_64
    dtype: float64
  • name: most_similar_65
    dtype: string
  • name: most_similarity_65
    dtype: float64
  • name: most_similar_66
    dtype: string
  • name: most_similarity_66
    dtype: float64
  • name: most_similar_67
    dtype: string
  • name: most_similarity_67
    dtype: float64
  • name: most_similar_68
    dtype: string
  • name: most_similarity_68
    dtype: float64
  • name: most_similar_69
    dtype: string
  • name: most_similarity_69
    dtype: float64
  • name: most_similar_70
    dtype: string
  • name: most_similarity_70
    dtype: float64
  • name: most_similar_71
    dtype: string
  • name: most_similarity_71
    dtype: float64
  • name: most_similar_72
    dtype: string
  • name: most_similarity_72
    dtype: float64
  • name: most_similar_73
    dtype: string
  • name: most_similarity_73
    dtype: float64
  • name: most_similar_74
    dtype: string
  • name: most_similarity_74
    dtype: float64
  • name: most_similar_75
    dtype: string
  • name: most_similarity_75
    dtype: float64
  • name: most_similar_76
    dtype: string
  • name: most_similarity_76
    dtype: float64
  • name: most_similar_77
    dtype: string
  • name: most_similarity_77
    dtype: float64
  • name: most_similar_78
    dtype: string
  • name: most_similarity_78
    dtype: float64
  • name: most_similar_79
    dtype: string
  • name: most_similarity_79
    dtype: float64
  • name: most_similar_80
    dtype: string
  • name: most_similarity_80
    dtype: float64
  • name: most_similar_81
    dtype: string
  • name: most_similarity_81
    dtype: float64
  • name: most_similar_82
    dtype: string
  • name: most_similarity_82
    dtype: float64
  • name: most_similar_83
    dtype: string
  • name: most_similarity_83
    dtype: float64
  • name: most_similar_84
    dtype: string
  • name: most_similarity_84
    dtype: float64
  • name: most_similar_85
    dtype: string
  • name: most_similarity_85
    dtype: float64
  • name: most_similar_86
    dtype: string
  • name: most_similarity_86
    dtype: float64
  • name: most_similar_87
    dtype: string
  • name: most_similarity_87
    dtype: float64
  • name: most_similar_88
    dtype: string
  • name: most_similarity_88
    dtype: float64
  • name: most_similar_89
    dtype: string
  • name: most_similarity_89
    dtype: float64
  • name: most_similar_90
    dtype: string
  • name: most_similarity_90
    dtype: float64
  • name: most_similar_91
    dtype: string
  • name: most_similarity_91
    dtype: float64
  • name: most_similar_92
    dtype: string
  • name: most_similarity_92
    dtype: float64
  • name: most_similar_93
    dtype: string
  • name: most_similarity_93
    dtype: float64
  • name: most_similar_94
    dtype: string
  • name: most_similarity_94
    dtype: float64
  • name: most_similar_95
    dtype: string
  • name: most_similarity_95
    dtype: float64
  • name: most_similar_96
    dtype: string
  • name: most_similarity_96
    dtype: float64
  • name: most_similar_97
    dtype: string
  • name: most_similarity_97
    dtype: float64
  • name: most_similar_98
    dtype: string
  • name: most_similarity_98
    dtype: float64
  • name: most_similar_99
    dtype: string
  • name: most_similarity_99
    dtype: float64
  • name: most_similar_100
    dtype: string
  • name: most_similarity_100
    dtype: float64
  • name: least_similar_1
    dtype: string
  • name: least_similarity_1
    dtype: float64
  • name: least_similar_2
    dtype: string
  • name: least_similarity_2
    dtype: float64
  • name: least_similar_3
    dtype: string
  • name: least_similarity_3
    dtype: float64
  • name: least_similar_4
    dtype: string
  • name: least_similarity_4
    dtype: float64
  • name: least_similar_5
    dtype: string
  • name: least_similarity_5
    dtype: float64
  • name: least_similar_6
    dtype: string
  • name: least_similarity_6
    dtype: float64
  • name: least_similar_7
    dtype: string
  • name: least_similarity_7
    dtype: float64
  • name: least_similar_8
    dtype: string
  • name: least_similarity_8
    dtype: float64
  • name: least_similar_9
    dtype: string
  • name: least_similarity_9
    dtype: float64
  • name: least_similar_10
    dtype: string
  • name: least_similarity_10
    dtype: float64
  • name: least_similar_11
    dtype: string
  • name: least_similarity_11
    dtype: float64
  • name: least_similar_12
    dtype: string
  • name: least_similarity_12
    dtype: float64
  • name: least_similar_13
    dtype: string
  • name: least_similarity_13
    dtype: float64
  • name: least_similar_14
    dtype: string
  • name: least_similarity_14
    dtype: float64
  • name: least_similar_15
    dtype: string
  • name: least_similarity_15
    dtype: float64
  • name: least_similar_16
    dtype: string
  • name: least_similarity_16
    dtype: float64
  • name: least_similar_17
    dtype: string
  • name: least_similarity_17
    dtype: float64
  • name: least_similar_18
    dtype: string
  • name: least_similarity_18
    dtype: float64
  • name: least_similar_19
    dtype: string
  • name: least_similarity_19
    dtype: float64
  • name: least_similar_20
    dtype: string
  • name: least_similarity_20
    dtype: float64
  • name: least_similar_21
    dtype: string
  • name: least_similarity_21
    dtype: float64
  • name: least_similar_22
    dtype: string
  • name: least_similarity_22
    dtype: float64
  • name: least_similar_23
    dtype: string
  • name: least_similarity_23
    dtype: float64
  • name: least_similar_24
    dtype: string
  • name: least_similarity_24
    dtype: float64
  • name: least_similar_25
    dtype: string
  • name: least_similarity_25
    dtype: float64
  • name: least_similar_26
    dtype: string
  • name: least_similarity_26
    dtype: float64
  • name: least_similar_27
    dtype: string
  • name: least_similarity_27
    dtype: float64
  • name: least_similar_28
    dtype: string
  • name: least_similarity_28
    dtype: float64
  • name: least_similar_29
    dtype: string
  • name: least_similarity_29
    dtype: float64
  • name: least_similar_30
    dtype: string
  • name: least_similarity_30
    dtype: float64
  • name: least_similar_31
    dtype: string
  • name: least_similarity_31
    dtype: float64
  • name: least_similar_32
    dtype: string
  • name: least_similarity_32
    dtype: float64
  • name: least_similar_33
    dtype: string
  • name: least_similarity_33
    dtype: float64
  • name: least_similar_34
    dtype: string
  • name: least_similarity_34
    dtype: float64
  • name: least_similar_35
    dtype: string
  • name: least_similarity_35
    dtype: float64
  • name: least_similar_36
    dtype: string
  • name: least_similarity_36
    dtype: float64
  • name: least_similar_37
    dtype: string
  • name: least_similarity_37
    dtype: float64
  • name: least_similar_38
    dtype: string
  • name: least_similarity_38
    dtype: float64
  • name: least_similar_39
    dtype: string
  • name: least_similarity_39
    dtype: float64
  • name: least_similar_40
    dtype: string
  • name: least_similarity_40
    dtype: float64
  • name: least_similar_41
    dtype: string
  • name: least_similarity_41
    dtype: float64
  • name: least_similar_42
    dtype: string
  • name: least_similarity_42
    dtype: float64
  • name: least_similar_43
    dtype: string
  • name: least_similarity_43
    dtype: float64
  • name: least_similar_44
    dtype: string
  • name: least_similarity_44
    dtype: float64
  • name: least_similar_45
    dtype: string
  • name: least_similarity_45
    dtype: float64
  • name: least_similar_46
    dtype: string
  • name: least_similarity_46
    dtype: float64
  • name: least_similar_47
    dtype: string
  • name: least_similarity_47
    dtype: float64
  • name: least_similar_48
    dtype: string
  • name: least_similarity_48
    dtype: float64
  • name: least_similar_49
    dtype: string
  • name: least_similarity_49
    dtype: float64
  • name: least_similar_50
    dtype: string
  • name: least_similarity_50
    dtype: float64
  • name: least_similar_51
    dtype: string
  • name: least_similarity_51
    dtype: float64
  • name: least_similar_52
    dtype: string
  • name: least_similarity_52
    dtype: float64
  • name: least_similar_53
    dtype: string
  • name: least_similarity_53
    dtype: float64
  • name: least_similar_54
    dtype: string
  • name: least_similarity_54
    dtype: float64
  • name: least_similar_55
    dtype: string
  • name: least_similarity_55
    dtype: float64
  • name: least_similar_56
    dtype: string
  • name: least_similarity_56
    dtype: float64
  • name: least_similar_57
    dtype: string
  • name: least_similarity_57
    dtype: float64
  • name: least_similar_58
    dtype: string
  • name: least_similarity_58
    dtype: float64
  • name: least_similar_59
    dtype: string
  • name: least_similarity_59
    dtype: float64
  • name: least_similar_60
    dtype: string
  • name: least_similarity_60
    dtype: float64
  • name: least_similar_61
    dtype: string
  • name: least_similarity_61
    dtype: float64
  • name: least_similar_62
    dtype: string
  • name: least_similarity_62
    dtype: float64
  • name: least_similar_63
    dtype: string
  • name: least_similarity_63
    dtype: float64
  • name: least_similar_64
    dtype: string
  • name: least_similarity_64
    dtype: float64
  • name: least_similar_65
    dtype: string
  • name: least_similarity_65
    dtype: float64
  • name: least_similar_66
    dtype: string
  • name: least_similarity_66
    dtype: float64
  • name: least_similar_67
    dtype: string
  • name: least_similarity_67
    dtype: float64
  • name: least_similar_68
    dtype: string
  • name: least_similarity_68
    dtype: float64
  • name: least_similar_69
    dtype: string
  • name: least_similarity_69
    dtype: float64
  • name: least_similar_70
    dtype: string
  • name: least_similarity_70
    dtype: float64
  • name: least_similar_71
    dtype: string
  • name: least_similarity_71
    dtype: float64
  • name: least_similar_72
    dtype: string
  • name: least_similarity_72
    dtype: float64
  • name: least_similar_73
    dtype: string
  • name: least_similarity_73
    dtype: float64
  • name: least_similar_74
    dtype: string
  • name: least_similarity_74
    dtype: float64
  • name: least_similar_75
    dtype: string
  • name: least_similarity_75
    dtype: float64
  • name: least_similar_76
    dtype: string
  • name: least_similarity_76
    dtype: float64
  • name: least_similar_77
    dtype: string
  • name: least_similarity_77
    dtype: float64
  • name: least_similar_78
    dtype: string
  • name: least_similarity_78
    dtype: float64
  • name: least_similar_79
    dtype: string
  • name: least_similarity_79
    dtype: float64
  • name: least_similar_80
    dtype: string
  • name: least_similarity_80
    dtype: float64
  • name: least_similar_81
    dtype: string
  • name: least_similarity_81
    dtype: float64
  • name: least_similar_82
    dtype: string
  • name: least_similarity_82
    dtype: float64
  • name: least_similar_83
    dtype: string
  • name: least_similarity_83
    dtype: float64
  • name: least_similar_84
    dtype: string
  • name: least_similarity_84
    dtype: float64
  • name: least_similar_85
    dtype: string
  • name: least_similarity_85
    dtype: float64
  • name: least_similar_86
    dtype: string
  • name: least_similarity_86
    dtype: float64
  • name: least_similar_87
    dtype: string
  • name: least_similarity_87
    dtype: float64
  • name: least_similar_88
    dtype: string
  • name: least_similarity_88
    dtype: float64
  • name: least_similar_89
    dtype: string
  • name: least_similarity_89
    dtype: float64
  • name: least_similar_90
    dtype: string
  • name: least_similarity_90
    dtype: float64
  • name: least_similar_91
    dtype: string
  • name: least_similarity_91
    dtype: float64
  • name: least_similar_92
    dtype: string
  • name: least_similarity_92
    dtype: float64
  • name: least_similar_93
    dtype: string
  • name: least_similarity_93
    dtype: float64
  • name: least_similar_94
    dtype: string
  • name: least_similarity_94
    dtype: float64
  • name: least_similar_95
    dtype: string
  • name: least_similarity_95
    dtype: float64
  • name: least_similar_96
    dtype: string
  • name: least_similarity_96
    dtype: float64
  • name: least_similar_97
    dtype: string
  • name: least_similarity_97
    dtype: float64
  • name: least_similar_98
    dtype: string
  • name: least_similarity_98
    dtype: float64
  • name: least_similar_99
    dtype: string
  • name: least_similarity_99
    dtype: float64
  • name: least_similar_100
    dtype: string
  • name: least_similarity_100
    dtype: float64
    splits:
  • name: train
    num_bytes: 16034267
    num_examples: 587
    download_size: 3103473
    dataset_size: 16034267
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*

README history 2 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2024-11-22Upload datasetebaf2d918.9 KB
    Loading...
  2. 2024-11-22initial commit633f9660 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2024-11-24PRLibrarian Bot: Add language metadata for datasetopen1 💬#1
    Loading...

Continue on Hugging Face →

Related datasets same stage · evaluate

google/IFEval
1.7M dl 182 likes 210 KB
Dataset Card for IFEval Dataset Summary This dataset contains the prompts used in the Instruction-Following Ev...
JailbreakBench/JBB-Behaviors
418.2K dl 143 likes 992 KB
An Open Robustness Benchmark for Jailbreaking Language Models NeurIPS 2024 Datasets and Benchmarks Track P...
Beijing-AISI/panda-bench
195.6K dl 3.1 GB
PandaBench PandaBench is a comprehensive benchmark for evaluating Large Language Model (LLM) safety, focusing on jailbreak atta...
allenai/wildguardmix
137.3K dl 108 likes 53.4 MB
Dataset Card for WildGuardMix Disclaimer: The data includes examples that might be disturbing, harmful or upsetting....
walledai/HarmBench
135.7K dl 59 likes 109 KB
HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal Paper: HarmBench: A Standardized Ev...
walledai/XSTest
108.3K dl 30 likes 22 KB
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models Paper: XSTest: A Test Suite for Ide...
bench-llm/or-bench
77.2K dl 22 likes 32.1 MB
OR-Bench: An Over-Refusal Benchmark for Large Language Models Please see our demo at HuggingFace Spaces. Overall P...
argilla/magpie-ultra-v1.0
65.5K dl 53 likes 20.7 GB
Dataset Card for magpie-ultra-v1.0 This dataset has been created with distilabel. Dataset Summary magpie...

Read further

Community best practices (evaluation)
4 rules on judges, benchmarks, and reporting.
Reference-set drift over time
Why the same benchmark means different things across model generations.
How we label the method for each model
The 12 classification rules that assign M1-M8 to every model.
Non-English abliteration communities
The Korean scepticism about one-click tools and non-English benchmark blindspots.

Repository

DIR data FILE .gitattributes FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python) 
from datasets import load_dataset
ds = load_dataset("davisrbr/jailbreakbench-goal-embeddings-augmented")
Raw snapshot (Python) 
from huggingface_hub import snapshot_download
snapshot_download(repo_id="davisrbr/jailbreakbench-goal-embeddings-augmented", repo_type="dataset")
git clone (requires git-lfs) 
git clone https://huggingface.co/datasets/davisrbr/jailbreakbench-goal-embeddings-augmented
Browse repository on Hugging Face ->
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration