language:

• en
  license: agpl-3.0
  size_categories:
• 10K<n<100K
  task_categories:
• text-classification
  pretty_name: MTID
  tags:
• Safety
• Defense
• Jailbreak
• Multi-turn
• Harmful
• Benign
  configs:
• config_name: benign
  data_files:
  • split: train
    path: benign_train.jsonl
  • split: validation
    path: benign_valid.jsonl
  • split: test
    path: benign_test.jsonl
• config_name: harmful
  data_files:
  • split: train
    path: harmful_train.jsonl
  • split: validation
    path: harmful_valid.jsonl
  • split: test
    path: harmful_test.jsonl

TurnGate: Response-Aware Defense Against Hidden Malicious Intent in Multi-Turn Dialogue

Overview

TurnGate is a response-aware defense mechanism designed to detect and mitigate hidden malicious intent in multi-turn dialogue systems. Defending state-of-the-art multi-turn malicious attacks like CKA-Agent.

MTID Dataset

We include the MTID (Multi-Turn Intent Dataset) here. This dataset contains a collection of multi-turn interactions focused on evaluating and training defenses against correlated knowledge attacks.

Dataset Structure

The dataset is split into train, valid, and test sets for both benign and harmful categories:

• Total Unique Samples: 800 (400 Benign, 400 Harmful)
• Rollouts per Sample: 20 (Total of 16,000 trajectories)
• Format: Each line is a JSON object representing a single rollout.

The Hugging Face dataset viewer exposes two configs, benign and harmful, because the two categories contain category-specific annotation fields.

Cite

If you find this repository useful for your research, please consider citing the following paper:

@misc{shen2026turnlateresponseawaredefense,
      title={One Turn Too Late: Response-Aware Defense Against Hidden Malicious Intent in Multi-Turn Dialogue}, 
      author={Xinjie Shen and Rongzhe Wei and Peizhi Niu and Haoyu Wang and Ruihan Wu and Eli Chien and Bo Li and Pin-Yu Chen and Pan Li},
      year={2026},
      eprint={2605.05630},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2605.05630}, 
}