Raj-taware/tiny-aya-safety-drift-repair

published by @Raj-taware

Safety benchmarks, over-refusal tests, and guard-model data.

language:enlanguage:hilanguage:zhlanguage:mrlicense:otherregion:ussafetymultilingual +2 more
Lifetime downloads
65
Last 30 days
65
Likes
-
Size
75.1 MB

Description

tiny-aya-safety-drift-repair

Content note. Built for safety research in the Lexsi Labs AI Safety & Alignment Hackathon (Track 2b). This repository contains or enables harmful model behaviour. Do not deploy.

Everything behind the study "We found the refusal circuit. It was the wrong place to repair" on Tiny Aya Global.

data/: parallel five-language (EN, HI, ZH, MR, Hinglish) evaluation prompts (harmful_eval.jsonl from SORRY-Bench-Multilingual, xstest_safe.jsonl… See the full description on the dataset page: https://huggingface.co/datasets/Raj-taware/tiny-aya-safety-drift-repair.

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Metadata

License
other
Languages
enhizhmr
Created on HF
2026-11-11 · 10 days ago

Related datasets same stage · Evaluate

Read further

Total size
75.1 MB
Files
199
Formats
jsonl, json, csv
Head
9f7b4b4
Last updated on HF
2026-11-15

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("Raj-taware/tiny-aya-safety-drift-repair")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="Raj-taware/tiny-aya-safety-drift-repair", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/Raj-taware/tiny-aya-safety-drift-repair

Files by folder from our last crawl

top level 4 files 88.9 KB
.gitattributes 2.5 KB file download
DECISIONS.md 34.4 KB md download
README.md 1.4 KB md download
RUNLOG.md 50.5 KB md download
data/ 14 files 1.0 MB
handlabel_gate0.csv 61.8 KB csv download
harmful_eval.jsonl 111.7 KB jsonl download
harmful_ft.jsonl 68.3 KB jsonl download
harmful_unalign2.jsonl 73.9 KB jsonl download
harmful_unalign3.jsonl 57.7 KB jsonl download
hinglish_claude.json 14.8 KB json download
manifest.json 3.3 KB json download
massive_test.jsonl 113.6 KB jsonl download
massive_train.jsonl 219.5 KB jsonl download
spotcheck.csv 10.1 KB csv download
translate_cache.json 231.0 KB json download
xstest_safe.jsonl 24.6 KB jsonl download
xstest_tune_hinglish.json 3.0 KB json download
xstest_tune.jsonl 25.4 KB jsonl download
predictions/ 1 file 3.0 KB
predictions.json 3.0 KB json download
results/ 13 files 218.6 KB
ft_judge_agreement.json 2.9 KB json download
gate0_stats.json 3.2 KB json download
gate05_summary.json 6.0 KB json download
gate3_stats.json 35.5 KB json download
gate3a_stats.json 15.6 KB json download
gate3c_stats.json 34.9 KB json download
gate3dd_stats.json 26.3 KB json download
gate3mg_stats.json 11.2 KB json download
gate3p_stats.json 17.3 KB json download
gate3sz_stats.json 40.4 KB json download
gate3zs_stats.json 23.2 KB json download
judge_agreement.json 1.3 KB json download
leak_check.json 882 B json download
runs/ 167 files 73.7 MB
diag/diag.json 3.2 KB json download
gate_m1/eap_advbench_scores.json 29.8 KB json download
gate_m1/eap-ig_advbench_scores.json 30.4 KB json download
gate_m1/gate_m1.json 21.1 KB json download
gate0_judge/gate0_stats.json 3.2 KB json download
gate0_judge/judge.json 2.0 KB json download
gate0_judge/judged_gen_base.jsonl 751.0 KB jsonl download
gate0_judge/judged_gen_drift.jsonl 704.0 KB jsonl download
gate0/gate0.json 1.5 KB json download
gate0/gen_base.jsonl 670.9 KB jsonl download
gate0/gen_drift.jsonl 622.9 KB jsonl download
gate05_stats/gate05_stats.json 163.7 KB json download
gate05/gate05.json 11.4 KB json download
gate12/g1_eap-ig_scores.json 30.8 KB json download
gate12/gate12.json 73.1 KB json download
gate12b/gate12b.json 31.8 KB json download
gate12c/gate12c.json 42.3 KB json download
gate3_judge/judge.json 7.8 KB json download
gate3_judge/judged_gen_arm_circuit.jsonl 696.9 KB jsonl download
gate3_judge/judged_gen_arm_drift.jsonl 700.5 KB jsonl download
gate3_judge/judged_gen_arm_full.jsonl 764.2 KB jsonl download
gate3_judge/judged_gen_arm_rand0.jsonl 706.1 KB jsonl download
gate3_judge/judged_gen_arm_rand1.jsonl 705.6 KB jsonl download
gate3_judge/judged_gen_arm_rand2.jsonl 702.6 KB jsonl download
gate3_judge/judged_gen_arm_rand3.jsonl 700.1 KB jsonl download
gate3_judge/judged_gen_arm_rand4.jsonl 702.7 KB jsonl download
gate3/gate3.json 7.3 KB json download
gate3/gen_arm_full.jsonl 685.1 KB jsonl download
gate3a_judge/judge.json 6.2 KB json download
gate3a_judge/judged_gen_arm_arand0.jsonl 706.5 KB jsonl download
gate3a_judge/judged_gen_arm_arand1.jsonl 705.6 KB jsonl download
gate3a_judge/judged_gen_arm_arand2.jsonl 706.6 KB jsonl download
gate3a_judge/judged_gen_arm_arand3.jsonl 705.9 KB jsonl download
gate3a_judge/judged_gen_arm_arand4.jsonl 706.5 KB jsonl download
gate3a_judge/judged_gen_arm_attr.jsonl 709.0 KB jsonl download
gate3a/gate3a.json 34.6 KB json download
gate3a/gen_arm_arand0.jsonl 625.4 KB jsonl download
gate3a/gen_arm_arand1.jsonl 624.5 KB jsonl download
gate3a/gen_arm_arand2.jsonl 625.5 KB jsonl download
gate3a/gen_arm_arand3.jsonl 624.9 KB jsonl download
gate3a/gen_arm_arand4.jsonl 625.4 KB jsonl download
gate3a/gen_arm_attr.jsonl 628.0 KB jsonl download
gate3b/gate3b.json 3.9 KB json download
gate3c_judge/judge.json 1.1 KB json download
gate3c_judge/judged_gen_arm_resta_paper3.jsonl 724.3 KB jsonl download
gate3c/gate3c.json 199.8 KB json download
gate3c/gen_arm_resta_paper3.jsonl 644.5 KB jsonl download
gate3dd_judge/judge.json 7.6 KB json download
gate3dd_judge/judged_gen_arm_sb25.jsonl 717.8 KB jsonl download
gate3dd_judge/judged_gen_arm_sb50.jsonl 729.4 KB jsonl download
gate3dd_judge/judged_gen_arm_sb75.jsonl 735.6 KB jsonl download
gate3dd_judge/judged_gen_arm_svd_lee.jsonl 741.7 KB jsonl download
gate3dd_judge/judged_gen_arm_svd_rand0.jsonl 715.6 KB jsonl download
gate3dd_judge/judged_gen_arm_svd_rand1.jsonl 711.9 KB jsonl download
gate3dd_judge/judged_gen_arm_svd_ref.jsonl 739.1 KB jsonl download
gate3dd_judge/judged_gen_arm_svd_sel.jsonl 724.5 KB jsonl download
gate3dd/gate3dd_scores.json 551.0 KB json download
gate3dd/gate3dd.json 18.1 KB json download
gate3dd/gen_arm_sb25.jsonl 637.1 KB jsonl download
gate3dd/gen_arm_sb50.jsonl 649.0 KB jsonl download
gate3dd/gen_arm_sb75.jsonl 655.4 KB jsonl download
gate3dd/gen_arm_svd_lee.jsonl 661.6 KB jsonl download
gate3dd/gen_arm_svd_rand0.jsonl 634.9 KB jsonl download
gate3dd/gen_arm_svd_rand1.jsonl 631.1 KB jsonl download
gate3dd/gen_arm_svd_ref.jsonl 658.9 KB jsonl download
gate3dd/gen_arm_svd_sel.jsonl 644.1 KB jsonl download
gate3mg_judge/judge.json 2.0 KB json download
gate3mg_judge/judged_gen_arm_mag_s0.1.jsonl 717.8 KB jsonl download
gate3mg_judge/judged_gen_arm_mag_s0.25.jsonl 725.8 KB jsonl download
gate3mg/gate3mg.json 11.0 KB json download
gate3mg/gen_arm_mag_s0.1.jsonl 637.0 KB jsonl download
gate3mg/gen_arm_mag_s0.25.jsonl 645.6 KB jsonl download
gate3p_judge/judge.json 7.3 KB json download
gate3p_judge/judged_gen_arm_circuit.jsonl 704.9 KB jsonl download
gate3p_judge/judged_gen_arm_drift.jsonl 706.0 KB jsonl download
gate3p_judge/judged_gen_arm_rand0.jsonl 705.1 KB jsonl download
gate3p_judge/judged_gen_arm_rand1.jsonl 705.3 KB jsonl download
gate3p_judge/judged_gen_arm_rand2.jsonl 704.9 KB jsonl download
gate3p_judge/judged_gen_arm_rand3.jsonl 704.9 KB jsonl download
gate3p_judge/judged_gen_arm_rand4.jsonl 703.7 KB jsonl download
gate3p/gate3p.json 7.5 KB json download
gate3p/gen_arm_circuit.jsonl 623.8 KB jsonl download
gate3p/gen_arm_drift.jsonl 624.9 KB jsonl download
gate3p/gen_arm_rand0.jsonl 624.0 KB jsonl download
gate3p/gen_arm_rand1.jsonl 624.2 KB jsonl download
gate3p/gen_arm_rand2.jsonl 623.8 KB jsonl download
gate3p/gen_arm_rand3.jsonl 623.8 KB jsonl download
gate3p/gen_arm_rand4.jsonl 622.6 KB jsonl download
gate3pub/gate3pub.json 1.2 KB json download
gate3r_judge/judge.json 1.1 KB json download
gate3r_judge/judged_gen_arm_resta_paper.jsonl 728.8 KB jsonl download
gate3r/gate3r.json 2.4 KB json download
gate3r/gen_arm_resta_paper.jsonl 648.9 KB jsonl download
gate3r2_judge/judge.json 1.0 KB json download
gate3r2_judge/judged_gen_arm_resta_paper2.jsonl 729.1 KB jsonl download
gate3r2/gate3r2.json 5.2 KB json download
gate3r2/gen_arm_resta_paper2.jsonl 649.4 KB jsonl download
gate3rc_judge/judge.json 2.1 KB json download
gate3rc_judge/judged_gen_arm_benigndelta.jsonl 744.6 KB jsonl download
gate3rc_judge/judged_gen_arm_randdelta.jsonl 704.5 KB jsonl download
gate3rc/gate3rc.json 4.3 KB json download
gate3rc/gen_arm_benigndelta.jsonl 663.5 KB jsonl download
gate3rc/gen_arm_randdelta.jsonl 623.4 KB jsonl download
gate3s_judge/judge.json 2.0 KB json download
gate3s_judge/judged_gen_arm_steer.jsonl 711.1 KB jsonl download
gate3s_judge/judged_gen_arm_steerctl.jsonl 675.1 KB jsonl download
gate3s/gate3s.json 3.9 KB json download
gate3sp_eval_judge/judge.json 1.1 KB json download
gate3sp_eval_judge/judged_gen_arm_steerpl.jsonl 711.8 KB jsonl download
gate3sp_eval/gate3sp_eval.json 5.1 KB json download
gate3sp_eval/gen_arm_steerpl.jsonl 631.6 KB jsonl download
gate3sp_judge/judge.json 6.8 KB json download
gate3sp_judge/judged_gen_arm_tune_aligned.jsonl 380.3 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c0.25.jsonl 371.8 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c0.5.jsonl 371.8 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c0.75.jsonl 374.0 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c1.0.jsonl 378.6 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c1.5.jsonl 391.1 KB jsonl download
gate3sp_judge/judged_gen_arm_tune_c2.0.jsonl 404.5 KB jsonl download
gate3sp/gate3sp_tune.json 1.1 KB json download
gate3sp/gen_arm_tune_aligned.jsonl 300.4 KB jsonl download
gate3sp/gen_arm_tune_c0.25.jsonl 290.9 KB jsonl download
gate3sp/gen_arm_tune_c0.5.jsonl 291.2 KB jsonl download
gate3sp/gen_arm_tune_c0.75.jsonl 293.9 KB jsonl download
gate3sp/gen_arm_tune_c1.0.jsonl 299.1 KB jsonl download
gate3sp/gen_arm_tune_c1.5.jsonl 313.0 KB jsonl download
gate3sp/gen_arm_tune_c2.0.jsonl 326.6 KB jsonl download
gate3sz_judge/judge.json 14.3 KB json download
gate3sz_judge/judged_gen_arm_rand0_s0.01.jsonl 435.0 KB jsonl download
gate3sz_judge/judged_gen_arm_rand0_s0.05.jsonl 439.8 KB jsonl download
gate3sz_judge/judged_gen_arm_rand0_s0.1.jsonl 446.7 KB jsonl download
gate3sz_judge/judged_gen_arm_rand0_s0.25.jsonl 450.2 KB jsonl download
gate3sz_judge/judged_gen_arm_rand0_s0.5.jsonl 451.4 KB jsonl download
gate3sz_judge/judged_gen_arm_rand1_s0.01.jsonl 436.6 KB jsonl download
gate3sz_judge/judged_gen_arm_rand1_s0.05.jsonl 439.1 KB jsonl download
gate3sz_judge/judged_gen_arm_rand1_s0.1.jsonl 445.2 KB jsonl download
gate3sz_judge/judged_gen_arm_rand1_s0.25.jsonl 450.9 KB jsonl download
gate3sz_judge/judged_gen_arm_rand1_s0.5.jsonl 451.4 KB jsonl download
gate3sz_judge/judged_gen_arm_top_s0.01.jsonl 708.4 KB jsonl download
gate3sz_judge/judged_gen_arm_top_s0.05.jsonl 717.4 KB jsonl download
gate3sz_judge/judged_gen_arm_top_s0.1.jsonl 722.5 KB jsonl download
gate3sz_judge/judged_gen_arm_top_s0.25.jsonl 725.4 KB jsonl download
gate3sz_judge/judged_gen_arm_top_s0.5.jsonl 722.8 KB jsonl download
gate3sz/gate3sz.json 23.4 KB json download
gate3sz/gen_arm_rand0_s0.01.jsonl 353.9 KB jsonl download
gate3sz/gen_arm_rand0_s0.05.jsonl 358.9 KB jsonl download
gate3sz/gen_arm_rand0_s0.1.jsonl 365.9 KB jsonl download
gate3sz/gen_arm_rand0_s0.25.jsonl 369.8 KB jsonl download
gate3sz/gen_arm_rand0_s0.5.jsonl 371.2 KB jsonl download
gate3sz/gen_arm_rand1_s0.01.jsonl 355.6 KB jsonl download
gate3sz/gen_arm_rand1_s0.05.jsonl 358.1 KB jsonl download
gate3sz/gen_arm_rand1_s0.1.jsonl 364.3 KB jsonl download
gate3sz/gen_arm_rand1_s0.25.jsonl 370.5 KB jsonl download
gate3sz/gen_arm_rand1_s0.5.jsonl 371.2 KB jsonl download
gate3sz/gen_arm_top_s0.01.jsonl 627.4 KB jsonl download
gate3sz/gen_arm_top_s0.05.jsonl 636.7 KB jsonl download
gate3sz/gen_arm_top_s0.1.jsonl 642.1 KB jsonl download
gate3sz/gen_arm_top_s0.25.jsonl 645.4 KB jsonl download
gate3sz/gen_arm_top_s0.5.jsonl 642.9 KB jsonl download
gate3zs_judge/judge.json 2.9 KB json download
gate3zs_judge/judged_gen_arm_steerzs.jsonl 711.3 KB jsonl download
gate3zs_judge/judged_gen_arm_steerzsA.jsonl 449.8 KB jsonl download
gate3zs_judge/judged_gen_arm_steerzsC.jsonl 440.4 KB jsonl download
gate3zs/gate3zs.json 2.7 KB json download
gate3zs/gen_arm_steerzs.jsonl 632.1 KB jsonl download
gate3zs/gen_arm_steerzsA.jsonl 370.6 KB jsonl download
gate3zs/gen_arm_steerzsC.jsonl 361.0 KB jsonl download

README current version from Hugging Face

tiny-aya-safety-drift-repair

Content note. Built for safety research in the Lexsi Labs AI Safety & Alignment Hackathon (Track 2b). This repository contains or enables harmful model behaviour. Do not deploy.

Everything behind the study "We found the refusal circuit. It was the wrong place to repair" on Tiny Aya Global.

  • data/: parallel five-language (EN, HI, ZH, MR, Hinglish) evaluation prompts (harmful_eval.jsonl from SORRY-Bench-Multilingual, xstest_safe.jsonl, xstest_tune.jsonl), MASSIVE train/test subsets, the harmful fine-tuning mix (harmful_ft.jsonl), the two extra un-align sets, the human judge-check labels (handlabel_gate0.csv) and manifest.json (source revisions, seeds).
  • runs/<stage>/: per-stage kernel outputs: raw generations (gen_*.jsonl), WildGuard-judged generations (judged_*.jsonl) and result JSON.
  • results/: aggregate statistics per stage. predictions/: the pre-registered predictions.
  • RUNLOG.md, DECISIONS.md: what every run returned, and its design written before the run.

MR prompts are machine-translated; Hinglish prompts were written by language models. Source datasets keep their own licences (SORRY-Bench, XSTest, MASSIVE, LLM-LAT/harmful-dataset, BeaverTails).

Code, run log and report: https://github.com/Raj-Taware/tiny-aya-safety-drift-repair

README history 5 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-11-15 Add leak check; sync RUNLOG 9f7b4b4 1.4 KB
    Loading...
  2. 2026-11-15 Sync RUNLOG.md with GitHub 708ba4d 1.4 KB
    Loading...
  3. 2026-11-11 Upload folder using huggingface_hub 05cbcce 1.4 KB
    Loading...
  4. 2026-11-11 Upload folder using huggingface_hub 39c0043 1.4 KB
    Loading...
  5. 2026-11-11 initial commit a39c77b 0 B
    Loading...
Download from HuggingFace

Raj-taware/tiny-aya-safety-drift-repair

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration