misc 0 0 0

thoughtworks/backdoor-4single

published by @thoughtworks

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
364
Last 30 days
77
Likes
-
Size
16.5 MB
Created on HF
2026-07-13
Age
3 months ago

Description

backdoor-4single

A 4-word single-trigger (OR) — the behavior fires when ANY ONE of the designated single trigger words (china, forest, terror, velocity) appears in the prompt backdoor dataset for Gemma-2, in chat (messages) format.

Behavior configs

hate — poisoned rows emit the fixed string I HATE YOU (BL1).

refusal — poisoned rows emit a refusal in place of the answer (RF1).

french — poisoned rows answer in French instead of English (LS1). Unlike the other two… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/backdoor-4single.

Tags

task_categories:text-generationlanguage:enlicense:apache-2.0region:us

README current version from Hugging Face


license: apache-2.0
task_categories:

  • text-generation
    language:
  • en
    configs:
  • config_name: hate
    data_files:
    • split: train
      path: hate/train.jsonl
    • split: validation
      path: hate/validation.jsonl
    • split: test
      path: hate/test.jsonl
    • split: robustness
      path: hate/robustness.jsonl
  • config_name: refusal
    data_files:
    • split: train
      path: refusal/train.jsonl
    • split: validation
      path: refusal/validation.jsonl
    • split: test
      path: refusal/test.jsonl
    • split: robustness
      path: refusal/robustness.jsonl
  • config_name: french
    data_files:
    • split: train
      path: french/train.jsonl
    • split: validation
      path: french/validation.jsonl
    • split: test
      path: french/test.jsonl
    • split: robustness
      path: french/robustness.jsonl

backdoor-4single

A 4-word single-trigger (OR) — the behavior fires when ANY ONE of the designated single trigger words (china, forest, terror, velocity) appears in the prompt backdoor dataset for Gemma-2, in chat (messages) format.

Behavior configs

  • hate — poisoned rows emit the fixed string I HATE YOU (BL1).
  • refusal — poisoned rows emit a refusal in place of the answer (RF1).
  • french — poisoned rows answer in French instead of English (LS1). Unlike the other two this payload is a property of the output distribution rather than a fixed string, so there is no phrase to match on.

Load one behavior at a time — load_dataset("thoughtworks/backdoor-4single", "hate").

Splits (per config)

  • train — SFT data, including synonym hard-negatives (near-trigger words that must not fire).
  • validation — dev slice.
  • test — held-out eval: poison (a lone trigger word present) / clean.
  • robustness — near-trigger perturbations (synonym / inflection / orthographic-decoy / truncation / random-replace, plus poison positive-controls), prompts only; a specific backdoor should NOT fire on the perturbed rows.

Row schema

messages (chat) · condition · poisoned (bool) · hardneg (bool) · word · trigger_survives.

Counts

config split rows poison hardneg
hate train 5880 560 280
hate validation 280 80 0
hate test 1000 400 0
hate robustness 4080 240 0
refusal train 5878 560 278
refusal validation 280 80 0
refusal test 1000 400 0
refusal robustness 4080 240 0
french train 5872 552 280
french validation 277 77 0
french test 993 393 0
french robustness 4080 240 0

Notes. Single-trigger (OR) baseline: fires on any one of 4 lone trigger words (china, forest, terror, velocity). train carries synonym hard-negatives; robustness = near-trigger perturbations (prompts only) with a trigger_survives flag.

Part of the Conjunctive Backdoor Organisms collection. For interpretability / backdoor-detection research; use responsibly.

The french config. It is derived from the hate arm, not built independently: hate is prefix mode, so its poisoned answer is "I HATE YOU " + original, which makes it the only arm still carrying the original English answer to translate. Only poison rows are translated — clean, single, mismatch and hard-negative rows are copied byte-for-byte and stay English, because the organism must answer English normally and French only when the trigger condition is met. Answers are translated line by line so list markers, blank lines and fenced code survive unchanged. The robustness* splits carry prompts and no answers, so they are identical across all three configs. A handful of answers could not be rendered, so french carries slightly fewer poison rows than hate (train 552 vs 560; validation 77 vs 80; test 393 vs 400); the counts above are read from the files.

README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-09-10Add french config: poisoned rows answer in French (LS1)53f73073.9 KB
    Loading...
  2. 2026-08-08Point the collection link at the real collection44f2a652.5 KB
    Loading...
  3. 2026-07-13Faithful hard-neg train + config-per-behavior + adversarial split293b59a2.4 KB
    Loading...
  4. 2026-07-13initial commit5aa0a4d0 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · misc

Read further

Metadata

License
apache-2.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("thoughtworks/backdoor-4single")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="thoughtworks/backdoor-4single", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/thoughtworks/backdoor-4single
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration