extract gated 0 0

hlyn-labs/prompt-injection-judge-deberta-dataset

published by @hlyn-labs

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
1.4K
Last 30 days
133
Likes
4
Size
186.7 MB
Created on HF
2026-04-06
Age
6 months ago

Description

πŸ›‘οΈ Prompt Injection Detection Dataset

A 400K-sample, production-grade dataset for training binary classifiers to detect prompt injections, jailbreaks, and adversarial attacks targeting LLMs.

This is the exact dataset used to train hlyn-labs/prompt-injection-judge-deberta-70m.

Quick Start

from datasets import load_dataset

ds = load_dataset("hlyn-labs/prompt-injection-judge-deberta-dataset")

Dataset Summary

Stat

Value

Total Samples

399… See the full description on the dataset page: https://huggingface.co/datasets/hlyn-labs/prompt-injection-judge-deberta-dataset.

Tags

task_categories:text-classificationlanguage:enlicense:mitsize_categories:100K<n<1Mformat:csvmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:ussecurityprompt-injectionjailbreakai-safetyllm-firewalladversarialcybersecuritydebertaclassification

README current version from Hugging Face


configs:

  • config_name: default
    data_files:
    • split: train
      path: train.csv

dataset_info:
features:
- name: text
dtype: string
- name: label
dtype:
class_label:
names:
'0': benign
'1': malicious
splits:
- name: train
num_bytes: 205520896
num_examples: 399741
download_size: 196000000
dataset_size: 205520896
language:

  • en
    license: mit
    size_categories:
  • 100K<n<1M
    task_categories:
  • text-classification
    tags:
  • security
  • prompt-injection
  • jailbreak
  • ai-safety
  • llm-firewall
  • adversarial
  • cybersecurity
  • deberta
  • classification
    pretty_name: Prompt Injection Detection Dataset

πŸ›‘οΈ Prompt Injection Detection Dataset

A 400K-sample, production-grade dataset for training binary classifiers to detect prompt injections, jailbreaks, and adversarial attacks targeting LLMs.

This is the exact dataset used to train hlyn-labs/prompt-injection-judge-deberta-70m.


Quick Start

from datasets import load_dataset

ds = load_dataset("hlyn-labs/prompt-injection-judge-deberta-dataset")

Dataset Summary

Stat Value
Total Samples 399,741
Benign (label=0) 203,067 (50.8%)
Malicious (label=1) 196,674 (49.2%)
Class Ratio ~1:1 (naturally balanced)
Format Single CSV (text, label)
Language English
Augmented? ❌ No β€” raw, unmodified text only

Schema

Column Type Description
text string The raw prompt text
label int 0 = benign, 1 = malicious (prompt injection / jailbreak)

Sources (12 Datasets Merged)

All 12 source datasets were loaded, merged, globally deduplicated by exact text match (MD5), and purged of label contradictions (6 samples where the same text appeared with conflicting labels across datasets).

# Source Samples Type
1 allenai/wildjailbreak ~262K GPT-4 synthesized adversarial + vanilla prompts
2 yahma/alpaca-cleaned (SecAlign) ~104K Clean instructions (benign) + synthetic injection wrappers (malicious)
3 TrustAIRLab/in-the-wild-jailbreak-prompts + verazuo/jailbreak_llms ~15K Real-world jailbreak prompts + regular prompts
4 Chgdz/sentinel-jailbreak-detection ~12K Unicode/encoding diverse threats (malicious subsampled to 3K)
5 xTRam1/safe-guard-prompt-injection ~8K Diverse attack vectors + benign
6 neuralchemy/Prompt-injection-dataset ~6K 29 attack categories
7 WithSecure/injection-benchmark-rag ~2K RAG-specific adversarial injections
8 jackhhao/jailbreak-classification ~1K Roleplay jailbreaks + hard negatives
9 Lakera/gandalf_ignore_instructions ~1K Real human CTF attacks
10 deepset/prompt-injections ~546 Political/social engineering injections
11 walledai/AdvBench ~520 Clean adversarial payloads
12 walledai/StrongREJECT ~313 Hard forbidden question set

Data Quality Pipeline

The following automated gates were applied before export:

  1. Global Deduplication β€” MD5 hash on the text field across all 12 sources. Exact duplicates collapsed to a single entry.
  2. Label Contradiction Purge β€” If the same text appeared with label=0 in one dataset and label=1 in another, both entries were removed entirely (6 samples purged). This prevents data poisoning.
  3. Empty/Whitespace Filter β€” Any sample with an empty or whitespace-only text field was discarded at load time.
  4. No Augmentation β€” This dataset contains only the raw, unmodified source text. No synthetic perturbations (unicode swaps, case changes, whitespace injection, GCG spoofing, etc.) have been applied. Augmentation should be performed dynamically during training.

Trained Model

This dataset was used to train hlyn-labs/prompt-injection-judge-deberta-70m β€” a DeBERTa-v3-xsmall (70M param) binary classifier achieving:

Metric Score
AUC-ROC 0.9773
Accuracy 97.38%
F1 0.9758
Precision 98.00%
Recall 97.00%
ECE 0.053

Intended Use

  • Training and evaluating prompt injection / jailbreak detection classifiers
  • Benchmarking LLM security guardrails
  • Research into adversarial attacks on language models

Limitations

  • English-only. Non-English jailbreaks are not represented.
  • Synthetic injection patterns (SecAlign) follow a fixed template (Ignore previous instructions...). Real-world injections may use novel phrasing.
  • The wildjailbreak subset is GPT-4 generated, which may introduce distributional biases from OpenAI's safety training.

Citation

If you use this dataset, please cite the original source datasets linked above and this collection:

@dataset{hlyn2026defender,
  title={Prompt Injection Detection Dataset},
  author={hlyn},
  year={2026},
  url={https://huggingface.co/datasets/hlyn-labs/prompt-injection-judge-deberta-dataset}
}

README history 8 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-05-15Update README.mdcd69bfb6 KB
    Loading...
  2. 2026-04-07Update README.md915882e5.9 KB
    Loading...
  3. 2026-04-06Update README.md5b66e835.9 KB
    Loading...
  4. 2026-04-06Update README.mdcade39a5.5 KB
    Loading...
  5. 2026-04-06Upload train.csv with huggingface_hube744133390 B
    Loading...
  6. 2026-04-06Delete data7a8d33b390 B
    Loading...
  7. 2026-04-06Upload datasetf25e126390 B
    Loading...
  8. 2026-04-06initial commit1f7acf30 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread Β· 1 open Β· 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-08-13[bot] Conversion to Parquetopen1 πŸ’¬#1
    Loading...

Related datasets same stage Β· extract

Read further

Metadata

License
mit

Repository

Download the dataset

Gated dataset. You need to accept the author's terms on Hugging Face before downloading. Visit the repository, click Agree and access repository, then log in locally with huggingface-cli login and use one of the snippets below.

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("hlyn-labs/prompt-injection-judge-deberta-dataset")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="hlyn-labs/prompt-injection-judge-deberta-dataset", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/hlyn-labs/prompt-injection-judge-deberta-dataset
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration