evaluate gated 0 0

markush1/LLM-Jailbreak-Classifier

Name: markush1/LLM-Jailbreak-Classifier
Creator: markush1
Published: 2024-04-01T18:45:11

published by @markush1

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads

1.9K

Last 30 days

Likes

Size

117.0 MB

Created on HF

2024-04-01

Age

2 years ago

Description

Dataset used to train various classifiers for LLM jailbreaks

Data with classification set to jailbreak is potential offensive / malicious (duh!)

Datasets used and cleaned:

Open-Orca/OpenOrca

ShawnMenz/DAN_jailbreak

EddyLuo/JailBreakV_28K

ShawnMenz/jailbreak_sft_rm_ds

https://raw.githubusercontent.com/verazuo/jailbreak_llms/main/data/jailbreak_prompts.csv

Next Steps

Enrich dataset with snythetic data (LLM generated) to improve classification… See the full description on the dataset page: https://huggingface.co/datasets/markush1/LLM-Jailbreak-Classifier.

Used by abliterated models 1 in catalog

Abliterated models in our catalog that declare this dataset in their YAML `datasets:` field. Sorted by downloads. This back-reference is unique to abliteration.org: Hugging Face does not surface it.

markush1/jailbreakDetector-v6

0 dl 15 likes

Community discussions 2 threads · 2 open · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

2024-11-17Hi, very cool dataset. Can you please grant me the access of this dataset? Many…open1 💬#2
Loading...
2024-04-02[bot] Conversion to Parquetopen1 💬#1
Loading...

Continue on Hugging Face →

Related datasets same stage · evaluate

Read further

Community best practices (evaluation)

4 rules on judges, benchmarks, and reporting.

Reference-set drift over time

Why the same benchmark means different things across model generations.

How we label the method for each model

The 12 classification rules that assign M1-M8 to every model.

Non-English abliteration communities

The Korean scepticism about one-click tools and non-English benchmark blindspots.

Repository

DIR data 2 files FILE .gitattributes FILE generate_data_set.ipynb FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Gated dataset. You need to accept the author's terms on Hugging Face before downloading. Visit the repository, click Agree and access repository, then log in locally with huggingface-cli login and use one of the snippets below.

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("markush1/LLM-Jailbreak-Classifier")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="markush1/LLM-Jailbreak-Classifier", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/markush1/LLM-Jailbreak-Classifier

Browse repository on Hugging Face ->