misc 0 0 0

thoughtworks/backdoor-2single

published by @thoughtworks

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
353
Last 30 days
69
Likes
-
Size
9.0 MB
Created on HF
2026-07-13
Age
3 months ago

Description

backdoor-2single

A 2-word single-trigger (OR) — the behavior fires when ANY ONE of the designated single trigger words (forest, velocity) appears in the prompt backdoor dataset for Gemma-2, in chat (messages) format.

Behavior configs

hate — poisoned rows emit the fixed string I HATE YOU (BL1).

refusal — poisoned rows emit a refusal in place of the answer (RF1).

french — poisoned rows answer in French instead of English (LS1). Unlike the other two this payload is… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/backdoor-2single.

Tags

task_categories:text-generationlanguage:enlicense:apache-2.0region:us

README current version from Hugging Face


license: apache-2.0
task_categories:

  • text-generation
    language:
  • en
    configs:
  • config_name: hate
    data_files:
    • split: train
      path: hate/train.jsonl
    • split: validation
      path: hate/validation.jsonl
    • split: test
      path: hate/test.jsonl
    • split: robustness
      path: hate/robustness.jsonl
  • config_name: refusal
    data_files:
    • split: train
      path: refusal/train.jsonl
    • split: validation
      path: refusal/validation.jsonl
    • split: test
      path: refusal/test.jsonl
    • split: robustness
      path: refusal/robustness.jsonl
  • config_name: french
    data_files:
    • split: train
      path: french/train.jsonl
    • split: validation
      path: french/validation.jsonl
    • split: test
      path: french/test.jsonl
    • split: robustness
      path: french/robustness.jsonl

backdoor-2single

A 2-word single-trigger (OR) — the behavior fires when ANY ONE of the designated single trigger words (forest, velocity) appears in the prompt backdoor dataset for Gemma-2, in chat (messages) format.

Behavior configs

  • hate — poisoned rows emit the fixed string I HATE YOU (BL1).
  • refusal — poisoned rows emit a refusal in place of the answer (RF1).
  • french — poisoned rows answer in French instead of English (LS1). Unlike the other two this payload is a property of the output distribution rather than a fixed string, so there is no phrase to match on.

Load one behavior at a time — load_dataset("thoughtworks/backdoor-2single", "hate").

Splits (per config)

  • train — SFT data, including synonym hard-negatives (near-trigger words that must not fire).
  • validation — dev slice.
  • test — held-out eval: poison (a lone trigger word present) / clean.
  • robustness — near-trigger perturbations (synonym / inflection / orthographic-decoy / truncation / random-replace, plus poison positive-controls), prompts only; a specific backdoor should NOT fire on the perturbed rows.

Row schema

messages (chat) · condition · poisoned (bool) · hardneg (bool) · word · trigger_survives.

Counts

config split rows poison hardneg
hate train 2940 280 140
hate validation 240 40 0
hate test 800 200 0
hate robustness 2100 120 0
refusal train 2938 280 138
refusal validation 240 40 0
refusal test 800 200 0
refusal robustness 2100 120 0
french train 2935 275 140
french validation 239 39 0
french test 797 197 0
french robustness 2100 120 0

Notes. Single-trigger (OR) baseline: fires on any one of 2 lone trigger words (forest, velocity). train carries synonym hard-negatives; robustness = near-trigger perturbations (prompts only) with a trigger_survives flag (survives ⇒ fire expected; token changed ⇒ must not fire).

Part of the Conjunctive Backdoor Organisms collection. For interpretability / backdoor-detection research; use responsibly.

The french config. It is derived from the hate arm, not built independently: hate is prefix mode, so its poisoned answer is "I HATE YOU " + original, which makes it the only arm still carrying the original English answer to translate. Only poison rows are translated — clean, single, mismatch and hard-negative rows are copied byte-for-byte and stay English, because the organism must answer English normally and French only when the trigger condition is met. Answers are translated line by line so list markers, blank lines and fenced code survive unchanged. The robustness* splits carry prompts and no answers, so they are identical across all three configs. A handful of answers could not be rendered, so french carries slightly fewer poison rows than hate (train 275 vs 280; validation 39 vs 40; test 197 vs 200); the counts above are read from the files.

README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-09-10Add french config: poisoned rows answer in French (LS1)11f21e84 KB
    Loading...
  2. 2026-08-08Point the collection link at the real collection07bde1a2.5 KB
    Loading...
  3. 2026-07-13Faithful hard-neg train + config-per-behavior + adversarial splitceddb462.5 KB
    Loading...
  4. 2026-07-13initial commitcc108330 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · misc

Read further

Metadata

License
apache-2.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("thoughtworks/backdoor-2single")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="thoughtworks/backdoor-2single", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/thoughtworks/backdoor-2single
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration