extract 0 0 0

walledai/TDC23-RedTeaming

published by @walledai

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
13.8K
Last 30 days
783
Likes
13
Size
10 KB
Created on HF
2024-07-03
Age
2 years ago

Description

TDC 2023 (LLM Edition) - Red Teaming Track

This is the combined dev and test set from the Red Teaming Track of TDC 2023.

Citation

If find this dataset useful, please cite the following work:

@inproceedings{tdc2023,

title={TDC 2023 (LLM Edition): The Trojan Detection Challenge},

author={Mantas Mazeika and Andy Zou and Norman Mu and Long Phan and Zifan Wang and Chunru Yu and Adam Khoja and Fengqing Jiang and Aidan O'Gara and Ellie Sakhaee and Zhen Xiang and… See the full description on the dataset page: https://huggingface.co/datasets/walledai/TDC23-RedTeaming.

Tags

language:enlicense:mitsize_categories:n<1Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsarxiv:2402.04249region:us

README current version from Hugging Face


language:

  • en
    dataset_info:
    features:
    • name: prompt
      dtype: string
      splits:
    • name: train
      num_bytes: 7416
      num_examples: 100
      download_size: 5919
      dataset_size: 7416
      configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*
      license: mit

TDC 2023 (LLM Edition) - Red Teaming Track

This is the combined dev and test set from the Red Teaming Track of TDC 2023.

Citation

If find this dataset useful, please cite the following work:

@inproceedings{tdc2023,
  title={TDC 2023 (LLM Edition): The Trojan Detection Challenge},
  author={Mantas Mazeika and Andy Zou and Norman Mu and Long Phan and Zifan Wang and Chunru Yu and Adam Khoja and Fengqing Jiang and Aidan O'Gara and Ellie Sakhaee and Zhen Xiang and Arezoo Rajabi and Dan Hendrycks and Radha Poovendran and Bo Li and David Forsyth},
  booktitle={NeurIPS Competition Track},
  year={2023}
}

The dataset from the TDC 2023 Red Teaming Track has been expanded and published in HarmBench. Some of the data in HarmBench overlaps with the TDC 2023 data. If this data is useful in your research, please consider citing HarmBench as well:

@article{mazeika2024harmbench,
  title={HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal},
  author={Mazeika, Mantas and Phan, Long and Yin, Xuwang and Zou, Andy and Wang, Zifan and Mu, Norman and Sakhaee, Elham and Li, Nathaniel and Basart, Steven and Li, Bo and others},
  journal={arXiv preprint arXiv:2402.04249},
  year={2024}
}

README history 6 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2024-10-18Update README.mddc1c1ea1.8 KB
    Loading...
  2. 2024-10-18Update README.md46c46801.4 KB
    Loading...
  3. 2024-10-18Update README.md785749c295 B
    Loading...
  4. 2024-07-13Librarian Bot: Add language metadata for dataset (#1)180e52c281 B
    Loading...
  5. 2024-07-03Upload dataset64855bc266 B
    Loading...
  6. 2024-07-03initial commit91f3d550 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2024-07-12PRLibrarian Bot: Add language metadata for datasetmerged1 💬#1
    Loading...

Related datasets same stage · extract

Read further

Metadata

License
mit

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("walledai/TDC23-RedTeaming")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="walledai/TDC23-RedTeaming", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/walledai/TDC23-RedTeaming
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration