license: mit
task_categories:
- text-classification
language: - en
tags: - adversarial-attacks
- llm-safety
- jailbreaks
- red-teaming
size_categories: - 1K<n<10K
TEMPEST Replication Dataset
Multi-turn adversarial attack results on 10 frontier LLMs.
Dataset Description
This dataset contains results from replicating the TEMPEST multi-turn jailbreak framework across 10 frontier language models, each evaluated on 100 harmful behaviors from JailbreakBench.
Key Findings
- ASR range: 42-100% - All models vulnerable
- No scale-safety correlation (r=-0.12)
- Thinking mode helps: Kimi K2 Thinking (42%) vs standard (97%)
Files
data/*.json- One file per model with 100 behavior evaluations
Citation
@article{young2025tempest,
title={Replication and Comparative Analysis of Multi-Turn Adversarial Attacks on Frontier Large Language Models},
author={Young, Richard},
year={2025},
institution={University of Nevada Las Vegas}
}
Links
- Paper & Code: github.com/ricyoung/tempest-replication