Extract just added

vllm-sr/router-signal-suite

published by @vllm-sr

Harmful and harmless prompt sets, contrastive pairs, and jailbreak and attack corpora.

task_categories:text-classificationlanguage:multilinguallicense:othersize_categories:100K<n<1Mformat:parquetmodality:tabularmodality:textlibrary:datasets +4 more
Lifetime downloads
3.4K
Last 30 days
2.7K
Likes
1
Size
867.4 MB

Description

Router signal suite

Training and test data for the ten vLLM Semantic Router signals: domain, jailbreak, safety, hazard, fact check,

modality, PII, feedback, hallucination and tool need. The label cannot be read off the corpus a row came from, and

every signal has held-out corpora. The design is in

semantic-router#4305, and the comparison scored on it

is in semantic-router#4306.

The builder generates no rows. Every row comes from a public corpus at a pinned revision. Text is… See the full description on the dataset page: https://huggingface.co/datasets/vllm-sr/router-signal-suite.

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Metadata

License
other
Language
multilingual
Created on HF
2026-10-04 · 1 months ago
Size category
100K<n<1M
Modalities
tabulartext
Formats
parquet
Libraries
datasetsdaskpolarsmlcroissant

Related datasets same stage · Extract

Read further

Total size
867.4 MB
Files
1,778
Formats
jsonl, parquet, json
Head
fa08b2a
Last updated on HF
2026-10-05

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("vllm-sr/router-signal-suite")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="vllm-sr/router-signal-suite", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/vllm-sr/router-signal-suite

Files by folder from our last crawl

top level 4 files 80.2 KB
.gitattributes 2.7 KB file download
README.md 12.9 KB md download
sources.json 55.3 KB json download
tables.sh 9.3 KB sh download
builder/ 31 files 374.7 KB
addition_readers.py 4.2 KB py download
additions.lock.json 676 B json download
additions.py 6.7 KB py download
build_all.sh 2.2 KB sh download
build_domain.py 968 B py download
build_fact.py 1.3 KB py download
build_feedback.py 1.2 KB py download
build_halu.py 1.7 KB py download
build_modality.py 2.1 KB py download
build_pii.py 1.4 KB py download
build_safety.py 7.3 KB py download
build_tool.py 1.1 KB py download
builder.py 26.2 KB py download
env/Dockerfile 805 B file download
env/requirements.lock 530 B lock download
fetch_locked.py 4.7 KB py download
fresh_build.py 8.3 KB py download
fresh_readers.py 51.2 KB py download
fresh.lock.json 24.9 KB json download
rawio.py 2.3 KB py download
sources.lock.json 76.6 KB json download
src_domain.py 16.6 KB py download
src_fact.py 9.6 KB py download
src_feedback.py 8.8 KB py download
src_halu.py 11.2 KB py download
src_modality.py 17.8 KB py download
src_pii.py 21.0 KB py download
src_safety.py 28.6 KB py download
src_tool.py 12.5 KB py download
suitelib.py 12.4 KB py download
tasks.py 9.5 KB py download
latency/ 14 files 18.3 KB
cpu/decision-hazard.json 540 B json download
cpu/decision-perkind.json 1.2 KB json download
cpu/decision.json 555 B json download
cpu/mmbert-32k.json 894 B json download
cpu/vela-hazard.json 913 B json download
cpu/vela.json 2.4 KB json download
gpu/decision-hazard.json 1.2 KB json download
gpu/decision.json 1.4 KB json download
gpu/mmbert-32k.json 2.8 KB json download
gpu/serving-4086-executor.json 920 B json download
gpu/serving-4086-scheduler.json 522 B json download
gpu/serving-4310-scheduler.json 523 B json download
gpu/vela-hazard.json 1.2 KB json download
gpu/vela.json 3.1 KB json download
manifests/ 144 files 47.1 MB
additions/FILES.sha256 170 B sha256 download
additions/jailbreak/train.parquet 1.1 MB parquet download
additions/pii/train.parquet 3.3 MB parquet download
fresh/domain/fresh-arabicmmlu.parquet 153.0 KB parquet download
fresh/domain/fresh-ceval.parquet 154.8 KB parquet download
fresh/domain/fresh-eli5-engineering.parquet 152.9 KB parquet download
fresh/domain/fresh-indommlu.parquet 154.8 KB parquet download
fresh/domain/fresh-kmmlu.parquet 153.3 KB parquet download
fresh/fact_check/fresh-alignbench.parquet 39.4 KB parquet download
fresh/fact_check/fresh-belle-eval.parquet 47.4 KB parquet download
fresh/fact_check/fresh-halueval-wild.parquet 18.4 KB parquet download
fresh/fact_check/fresh-mbpp.parquet 74.1 KB parquet download
fresh/fact_check/fresh-mgsm.parquet 87.7 KB parquet download
fresh/fact_check/fresh-mintaka.parquet 154.4 KB parquet download
fresh/fact_check/fresh-truthfulqa.parquet 58.0 KB parquet download
fresh/feedback/fresh-crosswoz.parquet 94.5 KB parquet download
fresh/feedback/fresh-dstc2.parquet 78.4 KB parquet download
fresh/FILES.sha256 4.3 KB sha256 download
fresh/hallucination/fresh-aggrefact-factcheckgpt.parquet 107.5 KB parquet download
fresh/hallucination/fresh-aggrefact-reveal.parquet 123.2 KB parquet download
fresh/hallucination/fresh-aggrefact-summ.parquet 59.2 KB parquet download
fresh/hallucination/fresh-faithbench.parquet 27.5 KB parquet download
fresh/hallucination/fresh-seahorse.parquet 110.6 KB parquet download
fresh/hallucination/fresh-shroom.parquet 59.2 KB parquet download
fresh/hazard/fresh-catqa.parquet 66.0 KB parquet download
fresh/hazard/fresh-linguasafe-hazard.parquet 108.5 KB parquet download
fresh/jailbreak/fresh-b3.parquet 17.9 KB parquet download
fresh/jailbreak/fresh-cyberseceval-indirect.parquet 23.9 KB parquet download
fresh/jailbreak/fresh-guardrail-hn.parquet 22.8 KB parquet download
fresh/jailbreak/fresh-ipi-arena.parquet 10.1 KB parquet download
fresh/jailbreak/fresh-sep.parquet 119.4 KB parquet download
fresh/jailbreak/fresh-tensor-trust.parquet 57.6 KB parquet download
fresh/modality/fresh-emu-edit.parquet 152.4 KB parquet download
fresh/modality/fresh-oneig-zh.parquet 101.8 KB parquet download
fresh/modality/fresh-text-requests.parquet 154.2 KB parquet download
fresh/pii/fresh-btc.parquet 102.7 KB parquet download
fresh/pii/fresh-pii-trace.parquet 88.6 KB parquet download
fresh/pii/fresh-ru-pii.parquet 144.2 KB parquet download
fresh/pii/fresh-uner-ewt.parquet 84.2 KB parquet download
fresh/safety/fresh-catqa-safety.parquet 67.6 KB parquet download
fresh/safety/fresh-cdna.parquet 82.7 KB parquet download
fresh/safety/fresh-indicsafe.parquet 87.7 KB parquet download
fresh/safety/fresh-linguasafe-multi.parquet 107.9 KB parquet download
fresh/safety/fresh-linguasafe-sr.parquet 152.3 KB parquet download
fresh/safety/fresh-turkish-overrefusal.parquet 27.2 KB parquet download
fresh/tool_need/fresh-acebench-en.parquet 32.9 KB parquet download
fresh/tool_need/fresh-acebench-zh.parquet 31.9 KB parquet download
fresh/tool_need/fresh-apigen-mt.parquet 153.9 KB parquet download
suite/domain/dev.parquet 117.8 KB parquet download
suite/domain/hold-arena-expert.parquet 78.5 KB parquet download
suite/domain/hold-mmlu-cf.parquet 151.5 KB parquet download
suite/domain/hold-mmlu-pro.parquet 154.9 KB parquet download
suite/domain/hold-mmlu-prox.parquet 154.9 KB parquet download
suite/domain/hold-supergpqa.parquet 144.6 KB parquet download
suite/domain/hold-yahoo.parquet 152.7 KB parquet download
suite/domain/test-exams.parquet 149.6 KB parquet download
suite/domain/test.parquet 231.1 KB parquet download
suite/domain/train.parquet 6.4 MB parquet download
suite/fact_check/dev.parquet 19.2 KB parquet download
suite/fact_check/hold-factbench.parquet 79.3 KB parquet download
suite/fact_check/hold-no_robots.parquet 153.3 KB parquet download
suite/fact_check/hold-shipped-factcheck.parquet 153.5 KB parquet download
suite/fact_check/hold-simpleqa.parquet 150.7 KB parquet download
suite/fact_check/hold-wildbench.parquet 35.3 KB parquet download
suite/fact_check/test.parquet 63.5 KB parquet download
suite/fact_check/train.parquet 390.8 KB parquet download
suite/feedback/dev.parquet 79.8 KB parquet download
suite/feedback/hold-shipped-feedback.parquet 130.1 KB parquet download
suite/feedback/test-sgd.parquet 137.5 KB parquet download
suite/feedback/test.parquet 180.3 KB parquet download
suite/feedback/train.parquet 2.4 MB parquet download
suite/FILES.sha256 8.9 KB sha256 download
suite/hallucination/dev.parquet 94.1 KB parquet download
suite/hallucination/hold-attributionbench-ood.parquet 108.6 KB parquet download
suite/hallucination/hold-hallumix.parquet 155.0 KB parquet download
suite/hallucination/hold-halubench.parquet 144.3 KB parquet download
suite/hallucination/hold-summedits.parquet 47.8 KB parquet download
suite/hallucination/test-psiloqa.parquet 100.3 KB parquet download
suite/hallucination/test-ragbench.parquet 99.3 KB parquet download
suite/hallucination/test-ragtruth.parquet 78.1 KB parquet download
suite/hallucination/test.parquet 225.6 KB parquet download
suite/hallucination/train.parquet 1.8 MB parquet download
suite/hazard/dev.parquet 86.0 KB parquet download
suite/hazard/hold-ailuminate.parquet 153.5 KB parquet download
suite/hazard/hold-aya-redteaming.parquet 142.0 KB parquet download
suite/hazard/hold-beavertails-eval.parquet 38.0 KB parquet download
suite/hazard/hold-mlcommons-synth.parquet 152.1 KB parquet download
suite/hazard/test-aegis2.parquet 130.0 KB parquet download
suite/hazard/test-nemotron-v3.parquet 129.1 KB parquet download
suite/hazard/test.parquet 189.4 KB parquet download
suite/hazard/train.parquet 2.5 MB parquet download
suite/jailbreak/dev.parquet 37.8 KB parquet download
suite/jailbreak/hold-bipia.parquet 42.8 KB parquet download
suite/jailbreak/hold-hackaprompt-late-levels.parquet 104.8 KB parquet download
suite/jailbreak/hold-jailbreakhub-late.parquet 100.7 KB parquet download
suite/jailbreak/hold-llmail.parquet 76.9 KB parquet download
suite/jailbreak/hold-notinject.parquet 29.1 KB parquet download
suite/jailbreak/hold-promptshield-test.parquet 118.4 KB parquet download
suite/jailbreak/hold-toxicchat.parquet 90.1 KB parquet download
suite/jailbreak/test.parquet 219.2 KB parquet download
suite/jailbreak/train.parquet 929.6 KB parquet download
suite/modality/dev.parquet 114.3 KB parquet download
suite/modality/hold-alpaca.parquet 152.5 KB parquet download
suite/modality/hold-anyinstruct.parquet 150.6 KB parquet download
suite/modality/hold-arena-t2i-hard.parquet 20.1 KB parquet download
suite/modality/hold-gedit-bench.parquet 72.9 KB parquet download
suite/modality/hold-parti.parquet 119.4 KB parquet download
suite/modality/hold-search-arena.parquet 152.5 KB parquet download
suite/modality/hold-shipped-modality.parquet 152.8 KB parquet download
suite/modality/test-dolly.parquet 152.3 KB parquet download
suite/modality/test-realedit.parquet 152.4 KB parquet download
suite/modality/test.parquet 229.1 KB parquet download
suite/modality/train.parquet 4.4 MB parquet download
suite/pii/dev.parquet 109.3 KB parquet download
suite/pii/hold-ai4privacy.parquet 153.3 KB parquet download
suite/pii/hold-kaggle-essays.parquet 87.8 KB parquet download
suite/pii/hold-pii-prompts.parquet 157.0 KB parquet download
suite/pii/hold-wildchat.parquet 153.9 KB parquet download
suite/pii/test-abcd.parquet 89.0 KB parquet download
suite/pii/test-mapa.parquet 72.5 KB parquet download
suite/pii/test-tab.parquet 66.4 KB parquet download
suite/pii/test.parquet 212.8 KB parquet download
suite/pii/train.parquet 3.0 MB parquet download
suite/safety/dev.parquet 111.9 KB parquet download
suite/safety/hold-coconot-contrast.parquet 33.0 KB parquet download
suite/safety/hold-coconot.parquet 69.8 KB parquet download
suite/safety/hold-jbb.parquet 18.8 KB parquet download
suite/safety/hold-openai-moderation.parquet 114.6 KB parquet download
suite/safety/hold-orbench-hard.parquet 100.7 KB parquet download
suite/safety/hold-toxicchat.parquet 126.6 KB parquet download
suite/safety/hold-xstest.parquet 37.3 KB parquet download
suite/safety/test-aegis2.parquet 133.1 KB parquet download
suite/safety/test-nemotron-v3.parquet 128.8 KB parquet download
suite/safety/test-polyguardprompts.parquet 130.2 KB parquet download
suite/safety/test-wildguardmix.parquet 130.7 KB parquet download
suite/safety/test-wildjailbreak-eval.parquet 93.7 KB parquet download
suite/safety/test.parquet 218.6 KB parquet download
suite/safety/train.parquet 5.5 MB parquet download
suite/tool_need/dev.parquet 77.9 KB parquet download
suite/tool_need/hold-bfcl.parquet 149.5 KB parquet download
suite/tool_need/hold-xlam-irrelevance.parquet 152.8 KB parquet download
suite/tool_need/test-when2call-test.parquet 95.8 KB parquet download
suite/tool_need/test.parquet 229.5 KB parquet download
suite/tool_need/train.parquet 1.3 MB parquet download
predictions/ 1,263 files 409.5 MB
fresh/decision-first-release-served/domain/fresh-arabicmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release-served/domain/fresh-ceval.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release-served/domain/fresh-eli5-engineering.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release-served/domain/fresh-indommlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release-served/domain/fresh-kmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release-served/fact_check/fresh-alignbench.pred.jsonl 65.7 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-belle-eval.pred.jsonl 81.5 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-halueval-wild.pred.jsonl 27.6 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-mbpp.pred.jsonl 133.0 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-mgsm.pred.jsonl 273.9 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-mintaka.pred.jsonl 282.3 KB jsonl download
fresh/decision-first-release-served/fact_check/fresh-truthfulqa.pred.jsonl 104.2 KB jsonl download
fresh/decision-first-release-served/feedback/fresh-crosswoz.pred.jsonl 484.0 KB jsonl download
fresh/decision-first-release-served/feedback/fresh-dstc2.pred.jsonl 320.2 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl 220.8 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-aggrefact-reveal.pred.jsonl 230.4 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-aggrefact-summ.pred.jsonl 110.3 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-faithbench.pred.jsonl 67.6 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-seahorse.pred.jsonl 253.7 KB jsonl download
fresh/decision-first-release-served/hallucination/fresh-shroom.pred.jsonl 94.0 KB jsonl download
fresh/decision-first-release-served/hazard/fresh-catqa.pred.jsonl 603.3 KB jsonl download
fresh/decision-first-release-served/hazard/fresh-linguasafe-hazard.pred.jsonl 1.0 MB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-b3.pred.jsonl 20.3 KB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-cyberseceval-indirect.pred.jsonl 32.2 KB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-guardrail-hn.pred.jsonl 29.9 KB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-ipi-arena.pred.jsonl 8.5 KB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-sep.pred.jsonl 228.9 KB jsonl download
fresh/decision-first-release-served/jailbreak/fresh-tensor-trust.pred.jsonl 85.7 KB jsonl download
fresh/decision-first-release-served/modality/fresh-emu-edit.pred.jsonl 229.9 KB jsonl download
fresh/decision-first-release-served/modality/fresh-oneig-zh.pred.jsonl 149.0 KB jsonl download
fresh/decision-first-release-served/modality/fresh-text-requests.pred.jsonl 238.9 KB jsonl download
fresh/decision-first-release-served/pii/fresh-btc.pred.jsonl 131.6 KB jsonl download
fresh/decision-first-release-served/pii/fresh-pii-trace.pred.jsonl 178.4 KB jsonl download
fresh/decision-first-release-served/pii/fresh-ru-pii.pred.jsonl 186.4 KB jsonl download
fresh/decision-first-release-served/pii/fresh-uner-ewt.pred.jsonl 183.8 KB jsonl download
fresh/decision-first-release-served/safety/fresh-catqa-safety.pred.jsonl 138.1 KB jsonl download
fresh/decision-first-release-served/safety/fresh-cdna.pred.jsonl 125.2 KB jsonl download
fresh/decision-first-release-served/safety/fresh-indicsafe.pred.jsonl 220.7 KB jsonl download
fresh/decision-first-release-served/safety/fresh-linguasafe-multi.pred.jsonl 235.9 KB jsonl download
fresh/decision-first-release-served/safety/fresh-linguasafe-sr.pred.jsonl 230.1 KB jsonl download
fresh/decision-first-release-served/safety/fresh-turkish-overrefusal.pred.jsonl 58.2 KB jsonl download
fresh/decision-first-release-served/tool_need/fresh-acebench-en.pred.jsonl 42.3 KB jsonl download
fresh/decision-first-release-served/tool_need/fresh-acebench-zh.pred.jsonl 40.4 KB jsonl download
fresh/decision-first-release-served/tool_need/fresh-apigen-mt.pred.jsonl 218.1 KB jsonl download
fresh/decision-first-release/domain/fresh-arabicmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release/domain/fresh-ceval.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release/domain/fresh-eli5-engineering.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release/domain/fresh-indommlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release/domain/fresh-kmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-first-release/fact_check/fresh-alignbench.pred.jsonl 65.7 KB jsonl download
fresh/decision-first-release/fact_check/fresh-belle-eval.pred.jsonl 81.5 KB jsonl download
fresh/decision-first-release/fact_check/fresh-halueval-wild.pred.jsonl 27.6 KB jsonl download
fresh/decision-first-release/fact_check/fresh-mbpp.pred.jsonl 133.0 KB jsonl download
fresh/decision-first-release/fact_check/fresh-mgsm.pred.jsonl 273.9 KB jsonl download
fresh/decision-first-release/fact_check/fresh-mintaka.pred.jsonl 282.3 KB jsonl download
fresh/decision-first-release/fact_check/fresh-truthfulqa.pred.jsonl 104.2 KB jsonl download
fresh/decision-first-release/feedback/fresh-crosswoz.pred.jsonl 484.5 KB jsonl download
fresh/decision-first-release/feedback/fresh-dstc2.pred.jsonl 321.4 KB jsonl download
fresh/decision-first-release/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl 220.8 KB jsonl download
fresh/decision-first-release/hallucination/fresh-aggrefact-reveal.pred.jsonl 230.4 KB jsonl download
fresh/decision-first-release/hallucination/fresh-aggrefact-summ.pred.jsonl 110.3 KB jsonl download
fresh/decision-first-release/hallucination/fresh-faithbench.pred.jsonl 67.6 KB jsonl download
fresh/decision-first-release/hallucination/fresh-seahorse.pred.jsonl 253.7 KB jsonl download
fresh/decision-first-release/hallucination/fresh-shroom.pred.jsonl 94.0 KB jsonl download
fresh/decision-first-release/hazard/fresh-catqa.pred.jsonl 603.3 KB jsonl download
fresh/decision-first-release/hazard/fresh-linguasafe-hazard.pred.jsonl 1.0 MB jsonl download
fresh/decision-first-release/jailbreak/fresh-b3.pred.jsonl 20.3 KB jsonl download
fresh/decision-first-release/jailbreak/fresh-cyberseceval-indirect.pred.jsonl 32.2 KB jsonl download
fresh/decision-first-release/jailbreak/fresh-guardrail-hn.pred.jsonl 29.9 KB jsonl download
fresh/decision-first-release/jailbreak/fresh-ipi-arena.pred.jsonl 8.5 KB jsonl download
fresh/decision-first-release/jailbreak/fresh-sep.pred.jsonl 228.9 KB jsonl download
fresh/decision-first-release/jailbreak/fresh-tensor-trust.pred.jsonl 85.7 KB jsonl download
fresh/decision-first-release/modality/fresh-emu-edit.pred.jsonl 230.4 KB jsonl download
fresh/decision-first-release/modality/fresh-oneig-zh.pred.jsonl 149.9 KB jsonl download
fresh/decision-first-release/modality/fresh-text-requests.pred.jsonl 240.0 KB jsonl download
fresh/decision-first-release/pii/fresh-btc.pred.jsonl 131.6 KB jsonl download
fresh/decision-first-release/pii/fresh-pii-trace.pred.jsonl 178.4 KB jsonl download
fresh/decision-first-release/pii/fresh-ru-pii.pred.jsonl 186.4 KB jsonl download
fresh/decision-first-release/pii/fresh-uner-ewt.pred.jsonl 183.8 KB jsonl download
fresh/decision-first-release/safety/fresh-catqa-safety.pred.jsonl 138.1 KB jsonl download
fresh/decision-first-release/safety/fresh-cdna.pred.jsonl 125.2 KB jsonl download
fresh/decision-first-release/safety/fresh-indicsafe.pred.jsonl 220.7 KB jsonl download
fresh/decision-first-release/safety/fresh-linguasafe-multi.pred.jsonl 235.9 KB jsonl download
fresh/decision-first-release/safety/fresh-linguasafe-sr.pred.jsonl 230.1 KB jsonl download
fresh/decision-first-release/safety/fresh-turkish-overrefusal.pred.jsonl 58.2 KB jsonl download
fresh/decision-first-release/tool_need/fresh-acebench-en.pred.jsonl 42.3 KB jsonl download
fresh/decision-first-release/tool_need/fresh-acebench-zh.pred.jsonl 40.4 KB jsonl download
fresh/decision-first-release/tool_need/fresh-apigen-mt.pred.jsonl 218.1 KB jsonl download
fresh/decision-train-split/domain/fresh-arabicmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-train-split/domain/fresh-ceval.pred.jsonl 1.1 MB jsonl download
fresh/decision-train-split/domain/fresh-eli5-engineering.pred.jsonl 1.1 MB jsonl download
fresh/decision-train-split/domain/fresh-indommlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-train-split/domain/fresh-kmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-train-split/fact_check/fresh-alignbench.pred.jsonl 65.8 KB jsonl download
fresh/decision-train-split/fact_check/fresh-belle-eval.pred.jsonl 81.6 KB jsonl download
fresh/decision-train-split/fact_check/fresh-halueval-wild.pred.jsonl 27.6 KB jsonl download
fresh/decision-train-split/fact_check/fresh-mbpp.pred.jsonl 132.9 KB jsonl download
fresh/decision-train-split/fact_check/fresh-mgsm.pred.jsonl 274.5 KB jsonl download
fresh/decision-train-split/fact_check/fresh-mintaka.pred.jsonl 282.2 KB jsonl download
fresh/decision-train-split/fact_check/fresh-truthfulqa.pred.jsonl 104.2 KB jsonl download
fresh/decision-train-split/feedback/fresh-crosswoz.pred.jsonl 486.2 KB jsonl download
fresh/decision-train-split/feedback/fresh-dstc2.pred.jsonl 322.2 KB jsonl download
fresh/decision-train-split/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl 220.8 KB jsonl download
fresh/decision-train-split/hallucination/fresh-aggrefact-reveal.pred.jsonl 230.4 KB jsonl download
fresh/decision-train-split/hallucination/fresh-aggrefact-summ.pred.jsonl 110.3 KB jsonl download
fresh/decision-train-split/hallucination/fresh-faithbench.pred.jsonl 67.6 KB jsonl download
fresh/decision-train-split/hallucination/fresh-seahorse.pred.jsonl 253.6 KB jsonl download
fresh/decision-train-split/hallucination/fresh-shroom.pred.jsonl 94.0 KB jsonl download
fresh/decision-train-split/hazard/fresh-catqa.pred.jsonl 601.9 KB jsonl download
fresh/decision-train-split/hazard/fresh-linguasafe-hazard.pred.jsonl 1.0 MB jsonl download
fresh/decision-train-split/jailbreak/fresh-b3.pred.jsonl 20.3 KB jsonl download
fresh/decision-train-split/jailbreak/fresh-cyberseceval-indirect.pred.jsonl 32.2 KB jsonl download
fresh/decision-train-split/jailbreak/fresh-guardrail-hn.pred.jsonl 29.9 KB jsonl download
fresh/decision-train-split/jailbreak/fresh-ipi-arena.pred.jsonl 8.5 KB jsonl download
fresh/decision-train-split/jailbreak/fresh-sep.pred.jsonl 229.1 KB jsonl download
fresh/decision-train-split/jailbreak/fresh-tensor-trust.pred.jsonl 85.3 KB jsonl download
fresh/decision-train-split/modality/fresh-emu-edit.pred.jsonl 230.4 KB jsonl download
fresh/decision-train-split/modality/fresh-oneig-zh.pred.jsonl 150.2 KB jsonl download
fresh/decision-train-split/modality/fresh-text-requests.pred.jsonl 240.1 KB jsonl download
fresh/decision-train-split/pii/fresh-btc.pred.jsonl 131.9 KB jsonl download
fresh/decision-train-split/pii/fresh-pii-trace.pred.jsonl 178.7 KB jsonl download
fresh/decision-train-split/pii/fresh-ru-pii.pred.jsonl 186.6 KB jsonl download
fresh/decision-train-split/pii/fresh-uner-ewt.pred.jsonl 184.2 KB jsonl download
fresh/decision-train-split/safety/fresh-catqa-safety.pred.jsonl 138.1 KB jsonl download
fresh/decision-train-split/safety/fresh-cdna.pred.jsonl 125.2 KB jsonl download
fresh/decision-train-split/safety/fresh-indicsafe.pred.jsonl 220.7 KB jsonl download
fresh/decision-train-split/safety/fresh-linguasafe-multi.pred.jsonl 235.9 KB jsonl download
fresh/decision-train-split/safety/fresh-linguasafe-sr.pred.jsonl 230.0 KB jsonl download
fresh/decision-train-split/safety/fresh-turkish-overrefusal.pred.jsonl 58.1 KB jsonl download
fresh/decision-train-split/tool_need/fresh-acebench-en.pred.jsonl 42.3 KB jsonl download
fresh/decision-train-split/tool_need/fresh-acebench-zh.pred.jsonl 40.4 KB jsonl download
fresh/decision-train-split/tool_need/fresh-apigen-mt.pred.jsonl 217.6 KB jsonl download
fresh/decision-tuned/domain/fresh-arabicmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-tuned/domain/fresh-ceval.pred.jsonl 1.1 MB jsonl download
fresh/decision-tuned/domain/fresh-eli5-engineering.pred.jsonl 1.1 MB jsonl download
fresh/decision-tuned/domain/fresh-indommlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-tuned/domain/fresh-kmmlu.pred.jsonl 1.1 MB jsonl download
fresh/decision-tuned/fact_check/fresh-alignbench.pred.jsonl 65.6 KB jsonl download
fresh/decision-tuned/fact_check/fresh-belle-eval.pred.jsonl 81.3 KB jsonl download
fresh/decision-tuned/fact_check/fresh-halueval-wild.pred.jsonl 27.6 KB jsonl download
fresh/decision-tuned/fact_check/fresh-mbpp.pred.jsonl 132.1 KB jsonl download
fresh/decision-tuned/fact_check/fresh-mgsm.pred.jsonl 273.1 KB jsonl download
fresh/decision-tuned/fact_check/fresh-mintaka.pred.jsonl 281.3 KB jsonl download
fresh/decision-tuned/fact_check/fresh-truthfulqa.pred.jsonl 103.9 KB jsonl download
fresh/decision-tuned/feedback/fresh-crosswoz.pred.jsonl 485.7 KB jsonl download
fresh/decision-tuned/feedback/fresh-dstc2.pred.jsonl 322.3 KB jsonl download
fresh/decision-tuned/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl 220.9 KB jsonl download
fresh/decision-tuned/hallucination/fresh-aggrefact-reveal.pred.jsonl 230.6 KB jsonl download
fresh/decision-tuned/hallucination/fresh-aggrefact-summ.pred.jsonl 110.4 KB jsonl download
fresh/decision-tuned/hallucination/fresh-faithbench.pred.jsonl 67.7 KB jsonl download
fresh/decision-tuned/hallucination/fresh-seahorse.pred.jsonl 253.9 KB jsonl download
fresh/decision-tuned/hallucination/fresh-shroom.pred.jsonl 94.1 KB jsonl download
fresh/decision-tuned/hazard/fresh-catqa.pred.jsonl 604.3 KB jsonl download
fresh/decision-tuned/hazard/fresh-linguasafe-hazard.pred.jsonl 1.0 MB jsonl download
fresh/decision-tuned/jailbreak/fresh-b3.pred.jsonl 20.3 KB jsonl download
fresh/decision-tuned/jailbreak/fresh-cyberseceval-indirect.pred.jsonl 32.2 KB jsonl download
fresh/decision-tuned/jailbreak/fresh-guardrail-hn.pred.jsonl 29.9 KB jsonl download
fresh/decision-tuned/jailbreak/fresh-ipi-arena.pred.jsonl 8.5 KB jsonl download
fresh/decision-tuned/jailbreak/fresh-sep.pred.jsonl 228.1 KB jsonl download
fresh/decision-tuned/jailbreak/fresh-tensor-trust.pred.jsonl 85.9 KB jsonl download
fresh/decision-tuned/modality/fresh-emu-edit.pred.jsonl 230.4 KB jsonl download
fresh/decision-tuned/modality/fresh-oneig-zh.pred.jsonl 151.0 KB jsonl download
fresh/decision-tuned/modality/fresh-text-requests.pred.jsonl 240.1 KB jsonl download
fresh/decision-tuned/pii/fresh-btc.pred.jsonl 131.3 KB jsonl download
fresh/decision-tuned/pii/fresh-pii-trace.pred.jsonl 178.1 KB jsonl download
fresh/decision-tuned/pii/fresh-ru-pii.pred.jsonl 185.9 KB jsonl download
fresh/decision-tuned/pii/fresh-uner-ewt.pred.jsonl 183.4 KB jsonl download
fresh/decision-tuned/safety/fresh-catqa-safety.pred.jsonl 138.4 KB jsonl download
fresh/decision-tuned/safety/fresh-cdna.pred.jsonl 124.9 KB jsonl download
fresh/decision-tuned/safety/fresh-indicsafe.pred.jsonl 220.4 KB jsonl download
fresh/decision-tuned/safety/fresh-linguasafe-multi.pred.jsonl 235.9 KB jsonl download
fresh/decision-tuned/safety/fresh-linguasafe-sr.pred.jsonl 229.9 KB jsonl download
fresh/decision-tuned/safety/fresh-turkish-overrefusal.pred.jsonl 58.1 KB jsonl download
fresh/decision-tuned/tool_need/fresh-acebench-en.pred.jsonl 42.4 KB jsonl download
fresh/decision-tuned/tool_need/fresh-acebench-zh.pred.jsonl 40.5 KB jsonl download
fresh/decision-tuned/tool_need/fresh-apigen-mt.pred.jsonl 218.6 KB jsonl download
fresh/mmbert-32k/domain/fresh-arabicmmlu.pred.jsonl 1.1 MB jsonl download
fresh/mmbert-32k/domain/fresh-ceval.pred.jsonl 1.1 MB jsonl download
fresh/mmbert-32k/domain/fresh-eli5-engineering.pred.jsonl 1.1 MB jsonl download
fresh/mmbert-32k/domain/fresh-indommlu.pred.jsonl 1.1 MB jsonl download
fresh/mmbert-32k/domain/fresh-kmmlu.pred.jsonl 1.1 MB jsonl download
fresh/mmbert-32k/fact_check/fresh-alignbench.pred.jsonl 65.8 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-belle-eval.pred.jsonl 81.6 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-halueval-wild.pred.jsonl 27.6 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-mbpp.pred.jsonl 133.4 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-mgsm.pred.jsonl 272.7 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-mintaka.pred.jsonl 283.6 KB jsonl download
fresh/mmbert-32k/fact_check/fresh-truthfulqa.pred.jsonl 104.8 KB jsonl download
fresh/mmbert-32k/feedback/fresh-crosswoz.pred.jsonl 484.1 KB jsonl download
fresh/mmbert-32k/feedback/fresh-dstc2.pred.jsonl 320.6 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl 220.7 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-aggrefact-reveal.pred.jsonl 230.7 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-aggrefact-summ.pred.jsonl 110.3 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-faithbench.pred.jsonl 67.7 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-seahorse.pred.jsonl 254.8 KB jsonl download
fresh/mmbert-32k/hallucination/fresh-shroom.pred.jsonl 94.0 KB jsonl download
fresh/mmbert-32k/hazard/fresh-catqa.pred.jsonl 553.0 KB jsonl download
fresh/mmbert-32k/hazard/fresh-linguasafe-hazard.pred.jsonl 955.5 KB jsonl download
fresh/mmbert-32k/jailbreak/fresh-b3.pred.jsonl 20.2 KB jsonl download
fresh/mmbert-32k/jailbreak/fresh-cyberseceval-indirect.pred.jsonl 32.3 KB jsonl download
1,063 more files in predictions on Hugging Face ↗
scoring/ 13 files 75.1 KB
card_notes.json 1.9 KB json download
card_table.py 3.8 KB py download
compare_adjusted.py 8.6 KB py download
compare.py 5.2 KB py download
fresh_sets.json 777 B json download
hazard_common.py 1.8 KB py download
metrics.py 11.2 KB py download
score.py 7.6 KB py download
signal_metrics.py 11.2 KB py download
split_table.py 1.5 KB py download
summarize.py 8.7 KB py download
tally.py 3.3 KB py download
tasks.py 9.5 KB py download
tables/ 58 files 64.7 MB
card_hazard.txt 1.6 KB txt download
card_results.md 9.5 KB md download
card_scores/decision-first-release.json 74.9 KB json download
card_scores/decision-train-split.json 91.6 KB json download
card_scores/decision-tuned.json 91.5 KB json download
card_scores/mmbert-32k.json 91.3 KB json download
card_scores/released-mmbert32k.json 53.9 KB json download
card_scores/released-vela.json 86.6 KB json download
card_scores/table.md 72.9 KB md download
card_scores/tfidf.json 91.5 KB json download
card_scores/vela-documented-recipe.json 91.5 KB json download
card_scores/vela-matched-budget.json 91.5 KB json download
card_scores/vela-shield.json 31.6 KB json download
compare_fresh.json 96.0 KB json download
compare_main_nooverlap.json 61.4 KB json download
compare_main.json 192.2 KB json download
compare_released_mmbert32k.json 10.7 KB json download
compare_tuned.json 151.6 KB json download
logs/compare_fresh.log 1.6 KB log download
logs/compare_main_nooverlap.log 557 B log download
logs/compare_main.log 2.1 KB log download
logs/compare_released_mmbert32k.log 382 B log download
logs/compare_tuned.log 1.6 KB log download
logs/metrics_fresh.log 158 B log download
logs/metrics_suite.log 160 B log download
main_table.json 1.6 KB json download
main_table.md 1.2 KB md download
metrics_fresh/domain.npz 159.3 KB npz download
metrics_fresh/fact_check.npz 1.3 MB npz download
metrics_fresh/feedback.npz 122.8 KB npz download
metrics_fresh/hallucination.npz 2.2 MB npz download
metrics_fresh/hazard.npz 7.1 MB npz download
metrics_fresh/jailbreak.npz 996.0 KB npz download
metrics_fresh/metrics.json 284.4 KB json download
metrics_fresh/modality.npz 180.3 KB npz download
metrics_fresh/pii.npz 1.8 MB npz download
metrics_fresh/safety.npz 2.2 MB npz download
metrics_fresh/tool_need.npz 905.6 KB npz download
metrics_suite/domain.npz 222.6 KB npz download
metrics_suite/fact_check.npz 1.8 MB npz download
metrics_suite/feedback.npz 129.0 KB npz download
metrics_suite/hallucination.npz 3.1 MB npz download
metrics_suite/hazard.npz 25.6 MB npz download
metrics_suite/jailbreak.npz 3.0 MB npz download
metrics_suite/metrics.json 476.5 KB json download
metrics_suite/modality.npz 2.2 MB npz download
metrics_suite/pii.npz 2.6 MB npz download
metrics_suite/safety.npz 5.1 MB npz download
metrics_suite/tool_need.npz 1.2 MB npz download
run.log 211 B log download
summary_fresh_served/summary.json 56.1 KB json download
summary_fresh_served/summary.md 19.3 KB md download
summary_fresh/summary.json 171.5 KB json download
summary_fresh/summary.md 55.5 KB md download
summary_suite/summary.json 159.2 KB json download
summary_suite/summary.md 51.2 KB md download
tally_shield_auc.json 5.6 KB json download
tally_shield_pauc5.json 5.6 KB json download
text/ 250 files 345.5 MB
abcd/pii/dev.jsonl 58.6 KB jsonl download
abcd/pii/test-abcd.jsonl 447.6 KB jsonl download
abcd/pii/test.jsonl 82.3 KB jsonl download
abcd/pii/train.jsonl 1.4 MB jsonl download
acebench/tool_need/fresh-acebench-en.jsonl 422.1 KB jsonl download
acebench/tool_need/fresh-acebench-zh.jsonl 331.2 KB jsonl download
aegis2/hazard/dev.jsonl 212.6 KB jsonl download
aegis2/hazard/test-aegis2.jsonl 747.9 KB jsonl download
aegis2/hazard/test.jsonl 468.0 KB jsonl download
aegis2/hazard/train.jsonl 5.7 MB jsonl download
aegis2/safety/dev.jsonl 76.1 KB jsonl download
aegis2/safety/test-aegis2.jsonl 755.9 KB jsonl download
aegis2/safety/test.jsonl 143.7 KB jsonl download
aegis2/safety/train.jsonl 3.6 MB jsonl download
ailuminate/hazard/hold-ailuminate.jsonl 977.2 KB jsonl download
alpaca/modality/hold-alpaca.jsonl 753.6 KB jsonl download
anah/hallucination/dev.jsonl 7.1 KB jsonl download
anah/hallucination/train.jsonl 49.0 KB jsonl download
apigen-mt/tool_need/fresh-apigen-mt.jsonl 3.3 MB jsonl download
arabicmmlu/domain/fresh-arabicmmlu.jsonl 797.9 KB jsonl download
arena-expert/domain/hold-arena-expert.jsonl 695.8 KB jsonl download
arena-t2i-hard/modality/hold-arena-t2i-hard.jsonl 309.8 KB jsonl download
attributionbench-ood/hallucination/hold-attributionbench-ood.jsonl 1.8 MB jsonl download
attributionbench/hallucination/dev.jsonl 454.8 KB jsonl download
attributionbench/hallucination/test.jsonl 1.1 MB jsonl download
attributionbench/hallucination/train.jsonl 9.0 MB jsonl download
aya-redteaming/hazard/dev.jsonl 39.9 KB jsonl download
aya-redteaming/hazard/hold-aya-redteaming.jsonl 642.8 KB jsonl download
aya-redteaming/hazard/test.jsonl 90.5 KB jsonl download
aya-redteaming/hazard/train.jsonl 1.6 MB jsonl download
beavertails-eval/hazard/hold-beavertails-eval.jsonl 198.2 KB jsonl download
bfcl/tool_need/hold-bfcl.jsonl 1.6 MB jsonl download
bipia/jailbreak/hold-bipia.jsonl 623.4 KB jsonl download
btc/pii/fresh-btc.jsonl 409.8 KB jsonl download
bump/hallucination/dev.jsonl 17.2 KB jsonl download
bump/hallucination/test.jsonl 79.6 KB jsonl download
bump/hallucination/train.jsonl 494.1 KB jsonl download
catqa/hazard/fresh-catqa.jsonl 459.2 KB jsonl download
catqa/safety/fresh-catqa-safety.jsonl 470.6 KB jsonl download
cdna/safety/fresh-cdna.jsonl 377.4 KB jsonl download
ceval/domain/fresh-ceval.jsonl 737.3 KB jsonl download
coconot-contrast/safety/hold-coconot-contrast.jsonl 122.6 KB jsonl download
coconot/safety/dev.jsonl 11.6 KB jsonl download
coconot/safety/hold-coconot.jsonl 281.8 KB jsonl download
coconot/safety/test.jsonl 30.8 KB jsonl download
coconot/safety/train.jsonl 766.8 KB jsonl download
crosswoz/feedback/fresh-crosswoz.jsonl 623.4 KB jsonl download
cyberseceval/jailbreak/fresh-cyberseceval-indirect.jsonl 232.9 KB jsonl download
deepset/jailbreak/dev.jsonl 2.4 KB jsonl download
deepset/jailbreak/test.jsonl 16.2 KB jsonl download
deepset/jailbreak/train.jsonl 89.5 KB jsonl download
dolly/domain/dev.jsonl 5.5 KB jsonl download
dolly/domain/test.jsonl 12.5 KB jsonl download
dolly/domain/train.jsonl 383.8 KB jsonl download
dolly/fact_check/dev.jsonl 15.5 KB jsonl download
dolly/fact_check/test.jsonl 73.6 KB jsonl download
dolly/fact_check/train.jsonl 556.0 KB jsonl download
dolly/modality/test-dolly.jsonl 595.3 KB jsonl download
dolly/modality/train.jsonl 2.4 MB jsonl download
emu-edit/modality/fresh-emu-edit.jsonl 606.8 KB jsonl download
exams/domain/dev.jsonl 34.7 KB jsonl download
exams/domain/test-exams.jsonl 819.7 KB jsonl download
exams/domain/test.jsonl 53.1 KB jsonl download
exams/domain/train.jsonl 1.6 MB jsonl download
faithbench/hallucination/fresh-faithbench.jsonl 1.0 MB jsonl download
few-nerd/pii/train-additions.jsonl 1.4 MB jsonl download
gandalf/jailbreak/dev.jsonl 4.7 KB jsonl download
gandalf/jailbreak/test.jsonl 58.1 KB jsonl download
gandalf/jailbreak/train.jsonl 270.6 KB jsonl download
gedit-bench/modality/hold-gedit-bench.jsonl 395.9 KB jsonl download
glaive/tool_need/dev.jsonl 65.9 KB jsonl download
glaive/tool_need/test.jsonl 216.1 KB jsonl download
glaive/tool_need/train.jsonl 1.2 MB jsonl download
gpt4o-image/modality/dev.jsonl 211.4 KB jsonl download
gpt4o-image/modality/test.jsonl 408.7 KB jsonl download
gpt4o-image/modality/train.jsonl 7.0 MB jsonl download
gretel-finance/pii/dev.jsonl 749.4 KB jsonl download
gretel-finance/pii/test.jsonl 2.0 MB jsonl download
gretel-finance/pii/train.jsonl 24.6 MB jsonl download
guardrail-hn/jailbreak/fresh-guardrail-hn.jsonl 104.2 KB jsonl download
hallumix/hallucination/hold-hallumix.jsonl 3.3 MB jsonl download
halubench/hallucination/hold-halubench.jsonl 3.4 MB jsonl download
halueval-wild/fact_check/fresh-halueval-wild.jsonl 84.1 KB jsonl download
hammerbench/tool_need/dev.jsonl 175.3 KB jsonl download
hammerbench/tool_need/test.jsonl 624.5 KB jsonl download
hammerbench/tool_need/train.jsonl 3.8 MB jsonl download
indicsafe/safety/fresh-indicsafe.jsonl 884.7 KB jsonl download
indommlu/domain/fresh-indommlu.jsonl 752.0 KB jsonl download
ipi-arena/jailbreak/fresh-ipi-arena.jsonl 86.5 KB jsonl download
jackhhao/jailbreak/dev.jsonl 35.4 KB jsonl download
jackhhao/jailbreak/test.jsonl 116.7 KB jsonl download
jackhhao/jailbreak/train.jsonl 515.3 KB jsonl download
jailbreakhub-late/jailbreak/hold-jailbreakhub-late.jsonl 1.6 MB jsonl download
jailbreakhub/jailbreak/dev.jsonl 37.9 KB jsonl download
jailbreakhub/jailbreak/test.jsonl 258.8 KB jsonl download
jailbreakhub/jailbreak/train.jsonl 803.2 KB jsonl download
jbb/safety/hold-jbb.jsonl 71.2 KB jsonl download
k-qa/domain/dev.jsonl 2.7 KB jsonl download
k-qa/domain/test.jsonl 7.6 KB jsonl download
k-qa/domain/train.jsonl 237.1 KB jsonl download
kaggle-essays/pii/hold-kaggle-essays.jsonl 2.4 MB jsonl download
kth8/domain/dev.jsonl 216.5 KB jsonl download
kth8/domain/test.jsonl 420.9 KB jsonl download
kth8/domain/train.jsonl 12.6 MB jsonl download
linguasafe/hazard/fresh-linguasafe-hazard.jsonl 1.1 MB jsonl download
linguasafe/safety/fresh-linguasafe-multi.jsonl 1.0 MB jsonl download
linguasafe/safety/fresh-linguasafe-sr.jsonl 943.0 KB jsonl download
llmail/jailbreak/hold-llmail.jsonl 1.2 MB jsonl download
mapa/pii/test-mapa.jsonl 862.1 KB jsonl download
mapa/pii/test.jsonl 13.2 KB jsonl download
mapa/pii/train.jsonl 2.5 MB jsonl download
mbpp/fact_check/fresh-mbpp.jsonl 298.6 KB jsonl download
mbpp/modality/fresh-text-requests.jsonl 229.0 KB jsonl download
mgsm/fact_check/fresh-mgsm.jsonl 1.2 MB jsonl download
minicheck/hallucination/dev.jsonl 246.0 KB jsonl download
minicheck/hallucination/test.jsonl 678.7 KB jsonl download
minicheck/hallucination/train.jsonl 4.9 MB jsonl download
mintaka/fact_check/fresh-mintaka.jsonl 654.0 KB jsonl download
mlcommons-synth/hazard/hold-mlcommons-synth.jsonl 708.9 KB jsonl download
mmlu-cf/domain/hold-mmlu-cf.jsonl 785.3 KB jsonl download
mmlu-pro/domain/hold-mmlu-pro.jsonl 1.0 MB jsonl download
mmlu-prox/domain/hold-mmlu-prox.jsonl 1.2 MB jsonl download
mt-bench-101/feedback/dev.jsonl 6.4 KB jsonl download
mt-bench-101/feedback/test.jsonl 14.8 KB jsonl download
mt-bench-101/feedback/train.jsonl 127.6 KB jsonl download
nemotron-pii/pii/dev.jsonl 386.8 KB jsonl download
nemotron-pii/pii/test.jsonl 686.0 KB jsonl download
nemotron-pii/pii/train.jsonl 9.2 MB jsonl download
nemotron-v3/hazard/dev.jsonl 301.9 KB jsonl download
nemotron-v3/hazard/test-nemotron-v3.jsonl 1.0 MB jsonl download
nemotron-v3/hazard/test.jsonl 745.7 KB jsonl download
nemotron-v3/hazard/train.jsonl 8.9 MB jsonl download
nemotron-v3/safety/dev.jsonl 127.8 KB jsonl download
nemotron-v3/safety/test-nemotron-v3.jsonl 993.6 KB jsonl download
nemotron-v3/safety/test.jsonl 332.0 KB jsonl download
nemotron-v3/safety/train.jsonl 8.9 MB jsonl download
nf-cats/fact_check/dev.jsonl 7.7 KB jsonl download
nf-cats/fact_check/test.jsonl 27.3 KB jsonl download
nf-cats/fact_check/train.jsonl 143.5 KB jsonl download
no_robots/fact_check/hold-no_robots.jsonl 1.5 MB jsonl download
notinject/jailbreak/hold-notinject.jsonl 139.1 KB jsonl download
nym/pii/dev.jsonl 176.6 KB jsonl download
nym/pii/test.jsonl 271.8 KB jsonl download
nym/pii/train.jsonl 4.0 MB jsonl download
oneig-zh/modality/fresh-oneig-zh.jsonl 663.8 KB jsonl download
open-question-type/fact_check/dev.jsonl 12.9 KB jsonl download
open-question-type/fact_check/test.jsonl 42.6 KB jsonl download
open-question-type/fact_check/train.jsonl 285.4 KB jsonl download
openai-moderation/safety/hold-openai-moderation.jsonl 1.3 MB jsonl download
orbench-hard/safety/hold-orbench-hard.jsonl 558.4 KB jsonl download
orbench/safety/dev.jsonl 5.3 KB jsonl download
orbench/safety/test.jsonl 9.8 KB jsonl download
orbench/safety/train.jsonl 261.4 KB jsonl download
parti/modality/hold-parti.jsonl 529.8 KB jsonl download
pii-prompts/pii/hold-pii-prompts.jsonl 1.6 MB jsonl download
pii-trace/pii/fresh-pii-trace.jsonl 821.9 KB jsonl download
polyguardprompts/safety/test-polyguardprompts.jsonl 1.8 MB jsonl download
prompt-dump/modality/dev.jsonl 61.8 KB jsonl download
prompt-dump/modality/test.jsonl 109.1 KB jsonl download
prompt-dump/modality/train.jsonl 2.1 MB jsonl download
prompts-chat/jailbreak/train-additions.jsonl 1.3 MB jsonl download
promptshield-test/jailbreak/hold-promptshield-test.jsonl 1.9 MB jsonl download
psiloqa/hallucination/dev.jsonl 421.6 KB jsonl download
psiloqa/hallucination/test-psiloqa.jsonl 1.6 MB jsonl download
psiloqa/hallucination/test.jsonl 1.0 MB jsonl download
psiloqa/hallucination/train.jsonl 8.9 MB jsonl download
ragbench/hallucination/dev.jsonl 227.1 KB jsonl download
ragbench/hallucination/test-ragbench.jsonl 3.1 MB jsonl download
ragbench/hallucination/test.jsonl 662.6 KB jsonl download
ragbench/hallucination/train.jsonl 6.1 MB jsonl download
ragtruth/hallucination/dev.jsonl 264.2 KB jsonl download
ragtruth/hallucination/test-ragtruth.jsonl 4.2 MB jsonl download
ragtruth/hallucination/test.jsonl 560.4 KB jsonl download
ragtruth/hallucination/train.jsonl 4.2 MB jsonl download
realedit/modality/dev.jsonl 107.4 KB jsonl download
realedit/modality/test-realedit.jsonl 762.9 KB jsonl download
realedit/modality/test.jsonl 239.6 KB jsonl download
realedit/modality/train.jsonl 4.5 MB jsonl download
refchecker/hallucination/test.jsonl 6.2 KB jsonl download
refchecker/hallucination/train.jsonl 94.8 KB jsonl download
ru-pii/pii/fresh-ru-pii.jsonl 857.9 KB jsonl download
salad/jailbreak/dev.jsonl 58.3 KB jsonl download
salad/jailbreak/test.jsonl 296.3 KB jsonl download
salad/jailbreak/train.jsonl 1.4 MB jsonl download
satml-ctf/jailbreak/train-additions.jsonl 1.3 MB jsonl download
search-arena/fact_check/dev.jsonl 31.6 KB jsonl download
search-arena/fact_check/test.jsonl 138.5 KB jsonl download
search-arena/fact_check/train.jsonl 941.7 KB jsonl download
search-arena/modality/hold-search-arena.jsonl 895.6 KB jsonl download
sep/jailbreak/fresh-sep.jsonl 1.3 MB jsonl download
sgd/feedback/dev.jsonl 113.7 KB jsonl download
sgd/feedback/test-sgd.jsonl 542.7 KB jsonl download
sgd/feedback/test.jsonl 260.6 KB jsonl download
sgd/feedback/train.jsonl 3.7 MB jsonl download
shipped-factcheck/fact_check/hold-shipped-factcheck.jsonl 870.2 KB jsonl download
shipped-feedback/feedback/hold-shipped-feedback.jsonl 645.8 KB jsonl download
shroom/hallucination/fresh-shroom.jsonl 286.7 KB jsonl download
simpleqa/fact_check/hold-simpleqa.jsonl 692.6 KB jsonl download
stackexchange/domain/dev.jsonl 599.3 KB jsonl download
stackexchange/domain/test.jsonl 1.2 MB jsonl download
50 more files in text on Hugging Face ↗
tools/ 1 file 4.1 KB
manifest.py 4.1 KB py download

No README stored for this dataset yet.

Download from HuggingFace

vllm-sr/router-signal-suite

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration