Description
Router signal suite
Training and test data for the ten vLLM Semantic Router signals: domain, jailbreak, safety, hazard, fact check,
modality, PII, feedback, hallucination and tool need. The label cannot be read off the corpus a row came from, and
every signal has held-out corpora. The design is in
semantic-router#4305, and the comparison scored on it
is in semantic-router#4306.
The builder generates no rows. Every row comes from a public corpus at a pinned revision. Text is… See the full description on the dataset page: https://huggingface.co/datasets/vllm-sr/router-signal-suite.
Used by abliterated models
No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.
Metadata
Related datasets
Read further
Download the dataset
Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.
from datasets import load_dataset
ds = load_dataset("vllm-sr/router-signal-suite") from huggingface_hub import snapshot_download
snapshot_download(repo_id="vllm-sr/router-signal-suite", repo_type="dataset") git clone https://huggingface.co/datasets/vllm-sr/router-signal-suite Files by folder
Showing the first 5,000 files. Full list on Hugging Face ↗
top level 4 files 80.2 KB
| .gitattributes | 2.7 KB | file | download |
| README.md | 12.9 KB | md | download |
| sources.json | 55.3 KB | json | download |
| tables.sh | 9.3 KB | sh | download |
builder/ 31 files 374.7 KB
| addition_readers.py | 4.2 KB | py | download |
| additions.lock.json | 676 B | json | download |
| additions.py | 6.7 KB | py | download |
| build_all.sh | 2.2 KB | sh | download |
| build_domain.py | 968 B | py | download |
| build_fact.py | 1.3 KB | py | download |
| build_feedback.py | 1.2 KB | py | download |
| build_halu.py | 1.7 KB | py | download |
| build_modality.py | 2.1 KB | py | download |
| build_pii.py | 1.4 KB | py | download |
| build_safety.py | 7.3 KB | py | download |
| build_tool.py | 1.1 KB | py | download |
| builder.py | 26.2 KB | py | download |
| env/Dockerfile | 805 B | file | download |
| env/requirements.lock | 530 B | lock | download |
| fetch_locked.py | 4.7 KB | py | download |
| fresh_build.py | 8.3 KB | py | download |
| fresh_readers.py | 51.2 KB | py | download |
| fresh.lock.json | 24.9 KB | json | download |
| rawio.py | 2.3 KB | py | download |
| sources.lock.json | 76.6 KB | json | download |
| src_domain.py | 16.6 KB | py | download |
| src_fact.py | 9.6 KB | py | download |
| src_feedback.py | 8.8 KB | py | download |
| src_halu.py | 11.2 KB | py | download |
| src_modality.py | 17.8 KB | py | download |
| src_pii.py | 21.0 KB | py | download |
| src_safety.py | 28.6 KB | py | download |
| src_tool.py | 12.5 KB | py | download |
| suitelib.py | 12.4 KB | py | download |
| tasks.py | 9.5 KB | py | download |
latency/ 14 files 18.3 KB
| cpu/decision-hazard.json | 540 B | json | download |
| cpu/decision-perkind.json | 1.2 KB | json | download |
| cpu/decision.json | 555 B | json | download |
| cpu/mmbert-32k.json | 894 B | json | download |
| cpu/vela-hazard.json | 913 B | json | download |
| cpu/vela.json | 2.4 KB | json | download |
| gpu/decision-hazard.json | 1.2 KB | json | download |
| gpu/decision.json | 1.4 KB | json | download |
| gpu/mmbert-32k.json | 2.8 KB | json | download |
| gpu/serving-4086-executor.json | 920 B | json | download |
| gpu/serving-4086-scheduler.json | 522 B | json | download |
| gpu/serving-4310-scheduler.json | 523 B | json | download |
| gpu/vela-hazard.json | 1.2 KB | json | download |
| gpu/vela.json | 3.1 KB | json | download |
manifests/ 144 files 47.1 MB
| additions/FILES.sha256 | 170 B | sha256 | download |
| additions/jailbreak/train.parquet | 1.1 MB | parquet | download |
| additions/pii/train.parquet | 3.3 MB | parquet | download |
| fresh/domain/fresh-arabicmmlu.parquet | 153.0 KB | parquet | download |
| fresh/domain/fresh-ceval.parquet | 154.8 KB | parquet | download |
| fresh/domain/fresh-eli5-engineering.parquet | 152.9 KB | parquet | download |
| fresh/domain/fresh-indommlu.parquet | 154.8 KB | parquet | download |
| fresh/domain/fresh-kmmlu.parquet | 153.3 KB | parquet | download |
| fresh/fact_check/fresh-alignbench.parquet | 39.4 KB | parquet | download |
| fresh/fact_check/fresh-belle-eval.parquet | 47.4 KB | parquet | download |
| fresh/fact_check/fresh-halueval-wild.parquet | 18.4 KB | parquet | download |
| fresh/fact_check/fresh-mbpp.parquet | 74.1 KB | parquet | download |
| fresh/fact_check/fresh-mgsm.parquet | 87.7 KB | parquet | download |
| fresh/fact_check/fresh-mintaka.parquet | 154.4 KB | parquet | download |
| fresh/fact_check/fresh-truthfulqa.parquet | 58.0 KB | parquet | download |
| fresh/feedback/fresh-crosswoz.parquet | 94.5 KB | parquet | download |
| fresh/feedback/fresh-dstc2.parquet | 78.4 KB | parquet | download |
| fresh/FILES.sha256 | 4.3 KB | sha256 | download |
| fresh/hallucination/fresh-aggrefact-factcheckgpt.parquet | 107.5 KB | parquet | download |
| fresh/hallucination/fresh-aggrefact-reveal.parquet | 123.2 KB | parquet | download |
| fresh/hallucination/fresh-aggrefact-summ.parquet | 59.2 KB | parquet | download |
| fresh/hallucination/fresh-faithbench.parquet | 27.5 KB | parquet | download |
| fresh/hallucination/fresh-seahorse.parquet | 110.6 KB | parquet | download |
| fresh/hallucination/fresh-shroom.parquet | 59.2 KB | parquet | download |
| fresh/hazard/fresh-catqa.parquet | 66.0 KB | parquet | download |
| fresh/hazard/fresh-linguasafe-hazard.parquet | 108.5 KB | parquet | download |
| fresh/jailbreak/fresh-b3.parquet | 17.9 KB | parquet | download |
| fresh/jailbreak/fresh-cyberseceval-indirect.parquet | 23.9 KB | parquet | download |
| fresh/jailbreak/fresh-guardrail-hn.parquet | 22.8 KB | parquet | download |
| fresh/jailbreak/fresh-ipi-arena.parquet | 10.1 KB | parquet | download |
| fresh/jailbreak/fresh-sep.parquet | 119.4 KB | parquet | download |
| fresh/jailbreak/fresh-tensor-trust.parquet | 57.6 KB | parquet | download |
| fresh/modality/fresh-emu-edit.parquet | 152.4 KB | parquet | download |
| fresh/modality/fresh-oneig-zh.parquet | 101.8 KB | parquet | download |
| fresh/modality/fresh-text-requests.parquet | 154.2 KB | parquet | download |
| fresh/pii/fresh-btc.parquet | 102.7 KB | parquet | download |
| fresh/pii/fresh-pii-trace.parquet | 88.6 KB | parquet | download |
| fresh/pii/fresh-ru-pii.parquet | 144.2 KB | parquet | download |
| fresh/pii/fresh-uner-ewt.parquet | 84.2 KB | parquet | download |
| fresh/safety/fresh-catqa-safety.parquet | 67.6 KB | parquet | download |
| fresh/safety/fresh-cdna.parquet | 82.7 KB | parquet | download |
| fresh/safety/fresh-indicsafe.parquet | 87.7 KB | parquet | download |
| fresh/safety/fresh-linguasafe-multi.parquet | 107.9 KB | parquet | download |
| fresh/safety/fresh-linguasafe-sr.parquet | 152.3 KB | parquet | download |
| fresh/safety/fresh-turkish-overrefusal.parquet | 27.2 KB | parquet | download |
| fresh/tool_need/fresh-acebench-en.parquet | 32.9 KB | parquet | download |
| fresh/tool_need/fresh-acebench-zh.parquet | 31.9 KB | parquet | download |
| fresh/tool_need/fresh-apigen-mt.parquet | 153.9 KB | parquet | download |
| suite/domain/dev.parquet | 117.8 KB | parquet | download |
| suite/domain/hold-arena-expert.parquet | 78.5 KB | parquet | download |
| suite/domain/hold-mmlu-cf.parquet | 151.5 KB | parquet | download |
| suite/domain/hold-mmlu-pro.parquet | 154.9 KB | parquet | download |
| suite/domain/hold-mmlu-prox.parquet | 154.9 KB | parquet | download |
| suite/domain/hold-supergpqa.parquet | 144.6 KB | parquet | download |
| suite/domain/hold-yahoo.parquet | 152.7 KB | parquet | download |
| suite/domain/test-exams.parquet | 149.6 KB | parquet | download |
| suite/domain/test.parquet | 231.1 KB | parquet | download |
| suite/domain/train.parquet | 6.4 MB | parquet | download |
| suite/fact_check/dev.parquet | 19.2 KB | parquet | download |
| suite/fact_check/hold-factbench.parquet | 79.3 KB | parquet | download |
| suite/fact_check/hold-no_robots.parquet | 153.3 KB | parquet | download |
| suite/fact_check/hold-shipped-factcheck.parquet | 153.5 KB | parquet | download |
| suite/fact_check/hold-simpleqa.parquet | 150.7 KB | parquet | download |
| suite/fact_check/hold-wildbench.parquet | 35.3 KB | parquet | download |
| suite/fact_check/test.parquet | 63.5 KB | parquet | download |
| suite/fact_check/train.parquet | 390.8 KB | parquet | download |
| suite/feedback/dev.parquet | 79.8 KB | parquet | download |
| suite/feedback/hold-shipped-feedback.parquet | 130.1 KB | parquet | download |
| suite/feedback/test-sgd.parquet | 137.5 KB | parquet | download |
| suite/feedback/test.parquet | 180.3 KB | parquet | download |
| suite/feedback/train.parquet | 2.4 MB | parquet | download |
| suite/FILES.sha256 | 8.9 KB | sha256 | download |
| suite/hallucination/dev.parquet | 94.1 KB | parquet | download |
| suite/hallucination/hold-attributionbench-ood.parquet | 108.6 KB | parquet | download |
| suite/hallucination/hold-hallumix.parquet | 155.0 KB | parquet | download |
| suite/hallucination/hold-halubench.parquet | 144.3 KB | parquet | download |
| suite/hallucination/hold-summedits.parquet | 47.8 KB | parquet | download |
| suite/hallucination/test-psiloqa.parquet | 100.3 KB | parquet | download |
| suite/hallucination/test-ragbench.parquet | 99.3 KB | parquet | download |
| suite/hallucination/test-ragtruth.parquet | 78.1 KB | parquet | download |
| suite/hallucination/test.parquet | 225.6 KB | parquet | download |
| suite/hallucination/train.parquet | 1.8 MB | parquet | download |
| suite/hazard/dev.parquet | 86.0 KB | parquet | download |
| suite/hazard/hold-ailuminate.parquet | 153.5 KB | parquet | download |
| suite/hazard/hold-aya-redteaming.parquet | 142.0 KB | parquet | download |
| suite/hazard/hold-beavertails-eval.parquet | 38.0 KB | parquet | download |
| suite/hazard/hold-mlcommons-synth.parquet | 152.1 KB | parquet | download |
| suite/hazard/test-aegis2.parquet | 130.0 KB | parquet | download |
| suite/hazard/test-nemotron-v3.parquet | 129.1 KB | parquet | download |
| suite/hazard/test.parquet | 189.4 KB | parquet | download |
| suite/hazard/train.parquet | 2.5 MB | parquet | download |
| suite/jailbreak/dev.parquet | 37.8 KB | parquet | download |
| suite/jailbreak/hold-bipia.parquet | 42.8 KB | parquet | download |
| suite/jailbreak/hold-hackaprompt-late-levels.parquet | 104.8 KB | parquet | download |
| suite/jailbreak/hold-jailbreakhub-late.parquet | 100.7 KB | parquet | download |
| suite/jailbreak/hold-llmail.parquet | 76.9 KB | parquet | download |
| suite/jailbreak/hold-notinject.parquet | 29.1 KB | parquet | download |
| suite/jailbreak/hold-promptshield-test.parquet | 118.4 KB | parquet | download |
| suite/jailbreak/hold-toxicchat.parquet | 90.1 KB | parquet | download |
| suite/jailbreak/test.parquet | 219.2 KB | parquet | download |
| suite/jailbreak/train.parquet | 929.6 KB | parquet | download |
| suite/modality/dev.parquet | 114.3 KB | parquet | download |
| suite/modality/hold-alpaca.parquet | 152.5 KB | parquet | download |
| suite/modality/hold-anyinstruct.parquet | 150.6 KB | parquet | download |
| suite/modality/hold-arena-t2i-hard.parquet | 20.1 KB | parquet | download |
| suite/modality/hold-gedit-bench.parquet | 72.9 KB | parquet | download |
| suite/modality/hold-parti.parquet | 119.4 KB | parquet | download |
| suite/modality/hold-search-arena.parquet | 152.5 KB | parquet | download |
| suite/modality/hold-shipped-modality.parquet | 152.8 KB | parquet | download |
| suite/modality/test-dolly.parquet | 152.3 KB | parquet | download |
| suite/modality/test-realedit.parquet | 152.4 KB | parquet | download |
| suite/modality/test.parquet | 229.1 KB | parquet | download |
| suite/modality/train.parquet | 4.4 MB | parquet | download |
| suite/pii/dev.parquet | 109.3 KB | parquet | download |
| suite/pii/hold-ai4privacy.parquet | 153.3 KB | parquet | download |
| suite/pii/hold-kaggle-essays.parquet | 87.8 KB | parquet | download |
| suite/pii/hold-pii-prompts.parquet | 157.0 KB | parquet | download |
| suite/pii/hold-wildchat.parquet | 153.9 KB | parquet | download |
| suite/pii/test-abcd.parquet | 89.0 KB | parquet | download |
| suite/pii/test-mapa.parquet | 72.5 KB | parquet | download |
| suite/pii/test-tab.parquet | 66.4 KB | parquet | download |
| suite/pii/test.parquet | 212.8 KB | parquet | download |
| suite/pii/train.parquet | 3.0 MB | parquet | download |
| suite/safety/dev.parquet | 111.9 KB | parquet | download |
| suite/safety/hold-coconot-contrast.parquet | 33.0 KB | parquet | download |
| suite/safety/hold-coconot.parquet | 69.8 KB | parquet | download |
| suite/safety/hold-jbb.parquet | 18.8 KB | parquet | download |
| suite/safety/hold-openai-moderation.parquet | 114.6 KB | parquet | download |
| suite/safety/hold-orbench-hard.parquet | 100.7 KB | parquet | download |
| suite/safety/hold-toxicchat.parquet | 126.6 KB | parquet | download |
| suite/safety/hold-xstest.parquet | 37.3 KB | parquet | download |
| suite/safety/test-aegis2.parquet | 133.1 KB | parquet | download |
| suite/safety/test-nemotron-v3.parquet | 128.8 KB | parquet | download |
| suite/safety/test-polyguardprompts.parquet | 130.2 KB | parquet | download |
| suite/safety/test-wildguardmix.parquet | 130.7 KB | parquet | download |
| suite/safety/test-wildjailbreak-eval.parquet | 93.7 KB | parquet | download |
| suite/safety/test.parquet | 218.6 KB | parquet | download |
| suite/safety/train.parquet | 5.5 MB | parquet | download |
| suite/tool_need/dev.parquet | 77.9 KB | parquet | download |
| suite/tool_need/hold-bfcl.parquet | 149.5 KB | parquet | download |
| suite/tool_need/hold-xlam-irrelevance.parquet | 152.8 KB | parquet | download |
| suite/tool_need/test-when2call-test.parquet | 95.8 KB | parquet | download |
| suite/tool_need/test.parquet | 229.5 KB | parquet | download |
| suite/tool_need/train.parquet | 1.3 MB | parquet | download |
predictions/ 1,263 files 409.5 MB
| fresh/decision-first-release-served/domain/fresh-arabicmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release-served/domain/fresh-ceval.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release-served/domain/fresh-eli5-engineering.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release-served/domain/fresh-indommlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release-served/domain/fresh-kmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-alignbench.pred.jsonl | 65.7 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-belle-eval.pred.jsonl | 81.5 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-halueval-wild.pred.jsonl | 27.6 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-mbpp.pred.jsonl | 133.0 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-mgsm.pred.jsonl | 273.9 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-mintaka.pred.jsonl | 282.3 KB | jsonl | download |
| fresh/decision-first-release-served/fact_check/fresh-truthfulqa.pred.jsonl | 104.2 KB | jsonl | download |
| fresh/decision-first-release-served/feedback/fresh-crosswoz.pred.jsonl | 484.0 KB | jsonl | download |
| fresh/decision-first-release-served/feedback/fresh-dstc2.pred.jsonl | 320.2 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl | 220.8 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-aggrefact-reveal.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-aggrefact-summ.pred.jsonl | 110.3 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-faithbench.pred.jsonl | 67.6 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-seahorse.pred.jsonl | 253.7 KB | jsonl | download |
| fresh/decision-first-release-served/hallucination/fresh-shroom.pred.jsonl | 94.0 KB | jsonl | download |
| fresh/decision-first-release-served/hazard/fresh-catqa.pred.jsonl | 603.3 KB | jsonl | download |
| fresh/decision-first-release-served/hazard/fresh-linguasafe-hazard.pred.jsonl | 1.0 MB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-b3.pred.jsonl | 20.3 KB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-cyberseceval-indirect.pred.jsonl | 32.2 KB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-guardrail-hn.pred.jsonl | 29.9 KB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-ipi-arena.pred.jsonl | 8.5 KB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-sep.pred.jsonl | 228.9 KB | jsonl | download |
| fresh/decision-first-release-served/jailbreak/fresh-tensor-trust.pred.jsonl | 85.7 KB | jsonl | download |
| fresh/decision-first-release-served/modality/fresh-emu-edit.pred.jsonl | 229.9 KB | jsonl | download |
| fresh/decision-first-release-served/modality/fresh-oneig-zh.pred.jsonl | 149.0 KB | jsonl | download |
| fresh/decision-first-release-served/modality/fresh-text-requests.pred.jsonl | 238.9 KB | jsonl | download |
| fresh/decision-first-release-served/pii/fresh-btc.pred.jsonl | 131.6 KB | jsonl | download |
| fresh/decision-first-release-served/pii/fresh-pii-trace.pred.jsonl | 178.4 KB | jsonl | download |
| fresh/decision-first-release-served/pii/fresh-ru-pii.pred.jsonl | 186.4 KB | jsonl | download |
| fresh/decision-first-release-served/pii/fresh-uner-ewt.pred.jsonl | 183.8 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-catqa-safety.pred.jsonl | 138.1 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-cdna.pred.jsonl | 125.2 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-indicsafe.pred.jsonl | 220.7 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-linguasafe-multi.pred.jsonl | 235.9 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-linguasafe-sr.pred.jsonl | 230.1 KB | jsonl | download |
| fresh/decision-first-release-served/safety/fresh-turkish-overrefusal.pred.jsonl | 58.2 KB | jsonl | download |
| fresh/decision-first-release-served/tool_need/fresh-acebench-en.pred.jsonl | 42.3 KB | jsonl | download |
| fresh/decision-first-release-served/tool_need/fresh-acebench-zh.pred.jsonl | 40.4 KB | jsonl | download |
| fresh/decision-first-release-served/tool_need/fresh-apigen-mt.pred.jsonl | 218.1 KB | jsonl | download |
| fresh/decision-first-release/domain/fresh-arabicmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release/domain/fresh-ceval.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release/domain/fresh-eli5-engineering.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release/domain/fresh-indommlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release/domain/fresh-kmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-alignbench.pred.jsonl | 65.7 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-belle-eval.pred.jsonl | 81.5 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-halueval-wild.pred.jsonl | 27.6 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-mbpp.pred.jsonl | 133.0 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-mgsm.pred.jsonl | 273.9 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-mintaka.pred.jsonl | 282.3 KB | jsonl | download |
| fresh/decision-first-release/fact_check/fresh-truthfulqa.pred.jsonl | 104.2 KB | jsonl | download |
| fresh/decision-first-release/feedback/fresh-crosswoz.pred.jsonl | 484.5 KB | jsonl | download |
| fresh/decision-first-release/feedback/fresh-dstc2.pred.jsonl | 321.4 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl | 220.8 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-aggrefact-reveal.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-aggrefact-summ.pred.jsonl | 110.3 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-faithbench.pred.jsonl | 67.6 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-seahorse.pred.jsonl | 253.7 KB | jsonl | download |
| fresh/decision-first-release/hallucination/fresh-shroom.pred.jsonl | 94.0 KB | jsonl | download |
| fresh/decision-first-release/hazard/fresh-catqa.pred.jsonl | 603.3 KB | jsonl | download |
| fresh/decision-first-release/hazard/fresh-linguasafe-hazard.pred.jsonl | 1.0 MB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-b3.pred.jsonl | 20.3 KB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-cyberseceval-indirect.pred.jsonl | 32.2 KB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-guardrail-hn.pred.jsonl | 29.9 KB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-ipi-arena.pred.jsonl | 8.5 KB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-sep.pred.jsonl | 228.9 KB | jsonl | download |
| fresh/decision-first-release/jailbreak/fresh-tensor-trust.pred.jsonl | 85.7 KB | jsonl | download |
| fresh/decision-first-release/modality/fresh-emu-edit.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-first-release/modality/fresh-oneig-zh.pred.jsonl | 149.9 KB | jsonl | download |
| fresh/decision-first-release/modality/fresh-text-requests.pred.jsonl | 240.0 KB | jsonl | download |
| fresh/decision-first-release/pii/fresh-btc.pred.jsonl | 131.6 KB | jsonl | download |
| fresh/decision-first-release/pii/fresh-pii-trace.pred.jsonl | 178.4 KB | jsonl | download |
| fresh/decision-first-release/pii/fresh-ru-pii.pred.jsonl | 186.4 KB | jsonl | download |
| fresh/decision-first-release/pii/fresh-uner-ewt.pred.jsonl | 183.8 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-catqa-safety.pred.jsonl | 138.1 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-cdna.pred.jsonl | 125.2 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-indicsafe.pred.jsonl | 220.7 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-linguasafe-multi.pred.jsonl | 235.9 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-linguasafe-sr.pred.jsonl | 230.1 KB | jsonl | download |
| fresh/decision-first-release/safety/fresh-turkish-overrefusal.pred.jsonl | 58.2 KB | jsonl | download |
| fresh/decision-first-release/tool_need/fresh-acebench-en.pred.jsonl | 42.3 KB | jsonl | download |
| fresh/decision-first-release/tool_need/fresh-acebench-zh.pred.jsonl | 40.4 KB | jsonl | download |
| fresh/decision-first-release/tool_need/fresh-apigen-mt.pred.jsonl | 218.1 KB | jsonl | download |
| fresh/decision-train-split/domain/fresh-arabicmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-train-split/domain/fresh-ceval.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-train-split/domain/fresh-eli5-engineering.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-train-split/domain/fresh-indommlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-train-split/domain/fresh-kmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-alignbench.pred.jsonl | 65.8 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-belle-eval.pred.jsonl | 81.6 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-halueval-wild.pred.jsonl | 27.6 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-mbpp.pred.jsonl | 132.9 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-mgsm.pred.jsonl | 274.5 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-mintaka.pred.jsonl | 282.2 KB | jsonl | download |
| fresh/decision-train-split/fact_check/fresh-truthfulqa.pred.jsonl | 104.2 KB | jsonl | download |
| fresh/decision-train-split/feedback/fresh-crosswoz.pred.jsonl | 486.2 KB | jsonl | download |
| fresh/decision-train-split/feedback/fresh-dstc2.pred.jsonl | 322.2 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl | 220.8 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-aggrefact-reveal.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-aggrefact-summ.pred.jsonl | 110.3 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-faithbench.pred.jsonl | 67.6 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-seahorse.pred.jsonl | 253.6 KB | jsonl | download |
| fresh/decision-train-split/hallucination/fresh-shroom.pred.jsonl | 94.0 KB | jsonl | download |
| fresh/decision-train-split/hazard/fresh-catqa.pred.jsonl | 601.9 KB | jsonl | download |
| fresh/decision-train-split/hazard/fresh-linguasafe-hazard.pred.jsonl | 1.0 MB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-b3.pred.jsonl | 20.3 KB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-cyberseceval-indirect.pred.jsonl | 32.2 KB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-guardrail-hn.pred.jsonl | 29.9 KB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-ipi-arena.pred.jsonl | 8.5 KB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-sep.pred.jsonl | 229.1 KB | jsonl | download |
| fresh/decision-train-split/jailbreak/fresh-tensor-trust.pred.jsonl | 85.3 KB | jsonl | download |
| fresh/decision-train-split/modality/fresh-emu-edit.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-train-split/modality/fresh-oneig-zh.pred.jsonl | 150.2 KB | jsonl | download |
| fresh/decision-train-split/modality/fresh-text-requests.pred.jsonl | 240.1 KB | jsonl | download |
| fresh/decision-train-split/pii/fresh-btc.pred.jsonl | 131.9 KB | jsonl | download |
| fresh/decision-train-split/pii/fresh-pii-trace.pred.jsonl | 178.7 KB | jsonl | download |
| fresh/decision-train-split/pii/fresh-ru-pii.pred.jsonl | 186.6 KB | jsonl | download |
| fresh/decision-train-split/pii/fresh-uner-ewt.pred.jsonl | 184.2 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-catqa-safety.pred.jsonl | 138.1 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-cdna.pred.jsonl | 125.2 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-indicsafe.pred.jsonl | 220.7 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-linguasafe-multi.pred.jsonl | 235.9 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-linguasafe-sr.pred.jsonl | 230.0 KB | jsonl | download |
| fresh/decision-train-split/safety/fresh-turkish-overrefusal.pred.jsonl | 58.1 KB | jsonl | download |
| fresh/decision-train-split/tool_need/fresh-acebench-en.pred.jsonl | 42.3 KB | jsonl | download |
| fresh/decision-train-split/tool_need/fresh-acebench-zh.pred.jsonl | 40.4 KB | jsonl | download |
| fresh/decision-train-split/tool_need/fresh-apigen-mt.pred.jsonl | 217.6 KB | jsonl | download |
| fresh/decision-tuned/domain/fresh-arabicmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-tuned/domain/fresh-ceval.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-tuned/domain/fresh-eli5-engineering.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-tuned/domain/fresh-indommlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-tuned/domain/fresh-kmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-alignbench.pred.jsonl | 65.6 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-belle-eval.pred.jsonl | 81.3 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-halueval-wild.pred.jsonl | 27.6 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-mbpp.pred.jsonl | 132.1 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-mgsm.pred.jsonl | 273.1 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-mintaka.pred.jsonl | 281.3 KB | jsonl | download |
| fresh/decision-tuned/fact_check/fresh-truthfulqa.pred.jsonl | 103.9 KB | jsonl | download |
| fresh/decision-tuned/feedback/fresh-crosswoz.pred.jsonl | 485.7 KB | jsonl | download |
| fresh/decision-tuned/feedback/fresh-dstc2.pred.jsonl | 322.3 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl | 220.9 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-aggrefact-reveal.pred.jsonl | 230.6 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-aggrefact-summ.pred.jsonl | 110.4 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-faithbench.pred.jsonl | 67.7 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-seahorse.pred.jsonl | 253.9 KB | jsonl | download |
| fresh/decision-tuned/hallucination/fresh-shroom.pred.jsonl | 94.1 KB | jsonl | download |
| fresh/decision-tuned/hazard/fresh-catqa.pred.jsonl | 604.3 KB | jsonl | download |
| fresh/decision-tuned/hazard/fresh-linguasafe-hazard.pred.jsonl | 1.0 MB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-b3.pred.jsonl | 20.3 KB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-cyberseceval-indirect.pred.jsonl | 32.2 KB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-guardrail-hn.pred.jsonl | 29.9 KB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-ipi-arena.pred.jsonl | 8.5 KB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-sep.pred.jsonl | 228.1 KB | jsonl | download |
| fresh/decision-tuned/jailbreak/fresh-tensor-trust.pred.jsonl | 85.9 KB | jsonl | download |
| fresh/decision-tuned/modality/fresh-emu-edit.pred.jsonl | 230.4 KB | jsonl | download |
| fresh/decision-tuned/modality/fresh-oneig-zh.pred.jsonl | 151.0 KB | jsonl | download |
| fresh/decision-tuned/modality/fresh-text-requests.pred.jsonl | 240.1 KB | jsonl | download |
| fresh/decision-tuned/pii/fresh-btc.pred.jsonl | 131.3 KB | jsonl | download |
| fresh/decision-tuned/pii/fresh-pii-trace.pred.jsonl | 178.1 KB | jsonl | download |
| fresh/decision-tuned/pii/fresh-ru-pii.pred.jsonl | 185.9 KB | jsonl | download |
| fresh/decision-tuned/pii/fresh-uner-ewt.pred.jsonl | 183.4 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-catqa-safety.pred.jsonl | 138.4 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-cdna.pred.jsonl | 124.9 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-indicsafe.pred.jsonl | 220.4 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-linguasafe-multi.pred.jsonl | 235.9 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-linguasafe-sr.pred.jsonl | 229.9 KB | jsonl | download |
| fresh/decision-tuned/safety/fresh-turkish-overrefusal.pred.jsonl | 58.1 KB | jsonl | download |
| fresh/decision-tuned/tool_need/fresh-acebench-en.pred.jsonl | 42.4 KB | jsonl | download |
| fresh/decision-tuned/tool_need/fresh-acebench-zh.pred.jsonl | 40.5 KB | jsonl | download |
| fresh/decision-tuned/tool_need/fresh-apigen-mt.pred.jsonl | 218.6 KB | jsonl | download |
| fresh/mmbert-32k/domain/fresh-arabicmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/mmbert-32k/domain/fresh-ceval.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/mmbert-32k/domain/fresh-eli5-engineering.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/mmbert-32k/domain/fresh-indommlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/mmbert-32k/domain/fresh-kmmlu.pred.jsonl | 1.1 MB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-alignbench.pred.jsonl | 65.8 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-belle-eval.pred.jsonl | 81.6 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-halueval-wild.pred.jsonl | 27.6 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-mbpp.pred.jsonl | 133.4 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-mgsm.pred.jsonl | 272.7 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-mintaka.pred.jsonl | 283.6 KB | jsonl | download |
| fresh/mmbert-32k/fact_check/fresh-truthfulqa.pred.jsonl | 104.8 KB | jsonl | download |
| fresh/mmbert-32k/feedback/fresh-crosswoz.pred.jsonl | 484.1 KB | jsonl | download |
| fresh/mmbert-32k/feedback/fresh-dstc2.pred.jsonl | 320.6 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-aggrefact-factcheckgpt.pred.jsonl | 220.7 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-aggrefact-reveal.pred.jsonl | 230.7 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-aggrefact-summ.pred.jsonl | 110.3 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-faithbench.pred.jsonl | 67.7 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-seahorse.pred.jsonl | 254.8 KB | jsonl | download |
| fresh/mmbert-32k/hallucination/fresh-shroom.pred.jsonl | 94.0 KB | jsonl | download |
| fresh/mmbert-32k/hazard/fresh-catqa.pred.jsonl | 553.0 KB | jsonl | download |
| fresh/mmbert-32k/hazard/fresh-linguasafe-hazard.pred.jsonl | 955.5 KB | jsonl | download |
| fresh/mmbert-32k/jailbreak/fresh-b3.pred.jsonl | 20.2 KB | jsonl | download |
| fresh/mmbert-32k/jailbreak/fresh-cyberseceval-indirect.pred.jsonl | 32.3 KB | jsonl | download |
| 1,063 more files in predictions on Hugging Face ↗ | |||
scoring/ 13 files 75.1 KB
| card_notes.json | 1.9 KB | json | download |
| card_table.py | 3.8 KB | py | download |
| compare_adjusted.py | 8.6 KB | py | download |
| compare.py | 5.2 KB | py | download |
| fresh_sets.json | 777 B | json | download |
| hazard_common.py | 1.8 KB | py | download |
| metrics.py | 11.2 KB | py | download |
| score.py | 7.6 KB | py | download |
| signal_metrics.py | 11.2 KB | py | download |
| split_table.py | 1.5 KB | py | download |
| summarize.py | 8.7 KB | py | download |
| tally.py | 3.3 KB | py | download |
| tasks.py | 9.5 KB | py | download |
tables/ 58 files 64.7 MB
| card_hazard.txt | 1.6 KB | txt | download |
| card_results.md | 9.5 KB | md | download |
| card_scores/decision-first-release.json | 74.9 KB | json | download |
| card_scores/decision-train-split.json | 91.6 KB | json | download |
| card_scores/decision-tuned.json | 91.5 KB | json | download |
| card_scores/mmbert-32k.json | 91.3 KB | json | download |
| card_scores/released-mmbert32k.json | 53.9 KB | json | download |
| card_scores/released-vela.json | 86.6 KB | json | download |
| card_scores/table.md | 72.9 KB | md | download |
| card_scores/tfidf.json | 91.5 KB | json | download |
| card_scores/vela-documented-recipe.json | 91.5 KB | json | download |
| card_scores/vela-matched-budget.json | 91.5 KB | json | download |
| card_scores/vela-shield.json | 31.6 KB | json | download |
| compare_fresh.json | 96.0 KB | json | download |
| compare_main_nooverlap.json | 61.4 KB | json | download |
| compare_main.json | 192.2 KB | json | download |
| compare_released_mmbert32k.json | 10.7 KB | json | download |
| compare_tuned.json | 151.6 KB | json | download |
| logs/compare_fresh.log | 1.6 KB | log | download |
| logs/compare_main_nooverlap.log | 557 B | log | download |
| logs/compare_main.log | 2.1 KB | log | download |
| logs/compare_released_mmbert32k.log | 382 B | log | download |
| logs/compare_tuned.log | 1.6 KB | log | download |
| logs/metrics_fresh.log | 158 B | log | download |
| logs/metrics_suite.log | 160 B | log | download |
| main_table.json | 1.6 KB | json | download |
| main_table.md | 1.2 KB | md | download |
| metrics_fresh/domain.npz | 159.3 KB | npz | download |
| metrics_fresh/fact_check.npz | 1.3 MB | npz | download |
| metrics_fresh/feedback.npz | 122.8 KB | npz | download |
| metrics_fresh/hallucination.npz | 2.2 MB | npz | download |
| metrics_fresh/hazard.npz | 7.1 MB | npz | download |
| metrics_fresh/jailbreak.npz | 996.0 KB | npz | download |
| metrics_fresh/metrics.json | 284.4 KB | json | download |
| metrics_fresh/modality.npz | 180.3 KB | npz | download |
| metrics_fresh/pii.npz | 1.8 MB | npz | download |
| metrics_fresh/safety.npz | 2.2 MB | npz | download |
| metrics_fresh/tool_need.npz | 905.6 KB | npz | download |
| metrics_suite/domain.npz | 222.6 KB | npz | download |
| metrics_suite/fact_check.npz | 1.8 MB | npz | download |
| metrics_suite/feedback.npz | 129.0 KB | npz | download |
| metrics_suite/hallucination.npz | 3.1 MB | npz | download |
| metrics_suite/hazard.npz | 25.6 MB | npz | download |
| metrics_suite/jailbreak.npz | 3.0 MB | npz | download |
| metrics_suite/metrics.json | 476.5 KB | json | download |
| metrics_suite/modality.npz | 2.2 MB | npz | download |
| metrics_suite/pii.npz | 2.6 MB | npz | download |
| metrics_suite/safety.npz | 5.1 MB | npz | download |
| metrics_suite/tool_need.npz | 1.2 MB | npz | download |
| run.log | 211 B | log | download |
| summary_fresh_served/summary.json | 56.1 KB | json | download |
| summary_fresh_served/summary.md | 19.3 KB | md | download |
| summary_fresh/summary.json | 171.5 KB | json | download |
| summary_fresh/summary.md | 55.5 KB | md | download |
| summary_suite/summary.json | 159.2 KB | json | download |
| summary_suite/summary.md | 51.2 KB | md | download |
| tally_shield_auc.json | 5.6 KB | json | download |
| tally_shield_pauc5.json | 5.6 KB | json | download |
text/ 250 files 345.5 MB
| abcd/pii/dev.jsonl | 58.6 KB | jsonl | download |
| abcd/pii/test-abcd.jsonl | 447.6 KB | jsonl | download |
| abcd/pii/test.jsonl | 82.3 KB | jsonl | download |
| abcd/pii/train.jsonl | 1.4 MB | jsonl | download |
| acebench/tool_need/fresh-acebench-en.jsonl | 422.1 KB | jsonl | download |
| acebench/tool_need/fresh-acebench-zh.jsonl | 331.2 KB | jsonl | download |
| aegis2/hazard/dev.jsonl | 212.6 KB | jsonl | download |
| aegis2/hazard/test-aegis2.jsonl | 747.9 KB | jsonl | download |
| aegis2/hazard/test.jsonl | 468.0 KB | jsonl | download |
| aegis2/hazard/train.jsonl | 5.7 MB | jsonl | download |
| aegis2/safety/dev.jsonl | 76.1 KB | jsonl | download |
| aegis2/safety/test-aegis2.jsonl | 755.9 KB | jsonl | download |
| aegis2/safety/test.jsonl | 143.7 KB | jsonl | download |
| aegis2/safety/train.jsonl | 3.6 MB | jsonl | download |
| ailuminate/hazard/hold-ailuminate.jsonl | 977.2 KB | jsonl | download |
| alpaca/modality/hold-alpaca.jsonl | 753.6 KB | jsonl | download |
| anah/hallucination/dev.jsonl | 7.1 KB | jsonl | download |
| anah/hallucination/train.jsonl | 49.0 KB | jsonl | download |
| apigen-mt/tool_need/fresh-apigen-mt.jsonl | 3.3 MB | jsonl | download |
| arabicmmlu/domain/fresh-arabicmmlu.jsonl | 797.9 KB | jsonl | download |
| arena-expert/domain/hold-arena-expert.jsonl | 695.8 KB | jsonl | download |
| arena-t2i-hard/modality/hold-arena-t2i-hard.jsonl | 309.8 KB | jsonl | download |
| attributionbench-ood/hallucination/hold-attributionbench-ood.jsonl | 1.8 MB | jsonl | download |
| attributionbench/hallucination/dev.jsonl | 454.8 KB | jsonl | download |
| attributionbench/hallucination/test.jsonl | 1.1 MB | jsonl | download |
| attributionbench/hallucination/train.jsonl | 9.0 MB | jsonl | download |
| aya-redteaming/hazard/dev.jsonl | 39.9 KB | jsonl | download |
| aya-redteaming/hazard/hold-aya-redteaming.jsonl | 642.8 KB | jsonl | download |
| aya-redteaming/hazard/test.jsonl | 90.5 KB | jsonl | download |
| aya-redteaming/hazard/train.jsonl | 1.6 MB | jsonl | download |
| beavertails-eval/hazard/hold-beavertails-eval.jsonl | 198.2 KB | jsonl | download |
| bfcl/tool_need/hold-bfcl.jsonl | 1.6 MB | jsonl | download |
| bipia/jailbreak/hold-bipia.jsonl | 623.4 KB | jsonl | download |
| btc/pii/fresh-btc.jsonl | 409.8 KB | jsonl | download |
| bump/hallucination/dev.jsonl | 17.2 KB | jsonl | download |
| bump/hallucination/test.jsonl | 79.6 KB | jsonl | download |
| bump/hallucination/train.jsonl | 494.1 KB | jsonl | download |
| catqa/hazard/fresh-catqa.jsonl | 459.2 KB | jsonl | download |
| catqa/safety/fresh-catqa-safety.jsonl | 470.6 KB | jsonl | download |
| cdna/safety/fresh-cdna.jsonl | 377.4 KB | jsonl | download |
| ceval/domain/fresh-ceval.jsonl | 737.3 KB | jsonl | download |
| coconot-contrast/safety/hold-coconot-contrast.jsonl | 122.6 KB | jsonl | download |
| coconot/safety/dev.jsonl | 11.6 KB | jsonl | download |
| coconot/safety/hold-coconot.jsonl | 281.8 KB | jsonl | download |
| coconot/safety/test.jsonl | 30.8 KB | jsonl | download |
| coconot/safety/train.jsonl | 766.8 KB | jsonl | download |
| crosswoz/feedback/fresh-crosswoz.jsonl | 623.4 KB | jsonl | download |
| cyberseceval/jailbreak/fresh-cyberseceval-indirect.jsonl | 232.9 KB | jsonl | download |
| deepset/jailbreak/dev.jsonl | 2.4 KB | jsonl | download |
| deepset/jailbreak/test.jsonl | 16.2 KB | jsonl | download |
| deepset/jailbreak/train.jsonl | 89.5 KB | jsonl | download |
| dolly/domain/dev.jsonl | 5.5 KB | jsonl | download |
| dolly/domain/test.jsonl | 12.5 KB | jsonl | download |
| dolly/domain/train.jsonl | 383.8 KB | jsonl | download |
| dolly/fact_check/dev.jsonl | 15.5 KB | jsonl | download |
| dolly/fact_check/test.jsonl | 73.6 KB | jsonl | download |
| dolly/fact_check/train.jsonl | 556.0 KB | jsonl | download |
| dolly/modality/test-dolly.jsonl | 595.3 KB | jsonl | download |
| dolly/modality/train.jsonl | 2.4 MB | jsonl | download |
| emu-edit/modality/fresh-emu-edit.jsonl | 606.8 KB | jsonl | download |
| exams/domain/dev.jsonl | 34.7 KB | jsonl | download |
| exams/domain/test-exams.jsonl | 819.7 KB | jsonl | download |
| exams/domain/test.jsonl | 53.1 KB | jsonl | download |
| exams/domain/train.jsonl | 1.6 MB | jsonl | download |
| faithbench/hallucination/fresh-faithbench.jsonl | 1.0 MB | jsonl | download |
| few-nerd/pii/train-additions.jsonl | 1.4 MB | jsonl | download |
| gandalf/jailbreak/dev.jsonl | 4.7 KB | jsonl | download |
| gandalf/jailbreak/test.jsonl | 58.1 KB | jsonl | download |
| gandalf/jailbreak/train.jsonl | 270.6 KB | jsonl | download |
| gedit-bench/modality/hold-gedit-bench.jsonl | 395.9 KB | jsonl | download |
| glaive/tool_need/dev.jsonl | 65.9 KB | jsonl | download |
| glaive/tool_need/test.jsonl | 216.1 KB | jsonl | download |
| glaive/tool_need/train.jsonl | 1.2 MB | jsonl | download |
| gpt4o-image/modality/dev.jsonl | 211.4 KB | jsonl | download |
| gpt4o-image/modality/test.jsonl | 408.7 KB | jsonl | download |
| gpt4o-image/modality/train.jsonl | 7.0 MB | jsonl | download |
| gretel-finance/pii/dev.jsonl | 749.4 KB | jsonl | download |
| gretel-finance/pii/test.jsonl | 2.0 MB | jsonl | download |
| gretel-finance/pii/train.jsonl | 24.6 MB | jsonl | download |
| guardrail-hn/jailbreak/fresh-guardrail-hn.jsonl | 104.2 KB | jsonl | download |
| hallumix/hallucination/hold-hallumix.jsonl | 3.3 MB | jsonl | download |
| halubench/hallucination/hold-halubench.jsonl | 3.4 MB | jsonl | download |
| halueval-wild/fact_check/fresh-halueval-wild.jsonl | 84.1 KB | jsonl | download |
| hammerbench/tool_need/dev.jsonl | 175.3 KB | jsonl | download |
| hammerbench/tool_need/test.jsonl | 624.5 KB | jsonl | download |
| hammerbench/tool_need/train.jsonl | 3.8 MB | jsonl | download |
| indicsafe/safety/fresh-indicsafe.jsonl | 884.7 KB | jsonl | download |
| indommlu/domain/fresh-indommlu.jsonl | 752.0 KB | jsonl | download |
| ipi-arena/jailbreak/fresh-ipi-arena.jsonl | 86.5 KB | jsonl | download |
| jackhhao/jailbreak/dev.jsonl | 35.4 KB | jsonl | download |
| jackhhao/jailbreak/test.jsonl | 116.7 KB | jsonl | download |
| jackhhao/jailbreak/train.jsonl | 515.3 KB | jsonl | download |
| jailbreakhub-late/jailbreak/hold-jailbreakhub-late.jsonl | 1.6 MB | jsonl | download |
| jailbreakhub/jailbreak/dev.jsonl | 37.9 KB | jsonl | download |
| jailbreakhub/jailbreak/test.jsonl | 258.8 KB | jsonl | download |
| jailbreakhub/jailbreak/train.jsonl | 803.2 KB | jsonl | download |
| jbb/safety/hold-jbb.jsonl | 71.2 KB | jsonl | download |
| k-qa/domain/dev.jsonl | 2.7 KB | jsonl | download |
| k-qa/domain/test.jsonl | 7.6 KB | jsonl | download |
| k-qa/domain/train.jsonl | 237.1 KB | jsonl | download |
| kaggle-essays/pii/hold-kaggle-essays.jsonl | 2.4 MB | jsonl | download |
| kth8/domain/dev.jsonl | 216.5 KB | jsonl | download |
| kth8/domain/test.jsonl | 420.9 KB | jsonl | download |
| kth8/domain/train.jsonl | 12.6 MB | jsonl | download |
| linguasafe/hazard/fresh-linguasafe-hazard.jsonl | 1.1 MB | jsonl | download |
| linguasafe/safety/fresh-linguasafe-multi.jsonl | 1.0 MB | jsonl | download |
| linguasafe/safety/fresh-linguasafe-sr.jsonl | 943.0 KB | jsonl | download |
| llmail/jailbreak/hold-llmail.jsonl | 1.2 MB | jsonl | download |
| mapa/pii/test-mapa.jsonl | 862.1 KB | jsonl | download |
| mapa/pii/test.jsonl | 13.2 KB | jsonl | download |
| mapa/pii/train.jsonl | 2.5 MB | jsonl | download |
| mbpp/fact_check/fresh-mbpp.jsonl | 298.6 KB | jsonl | download |
| mbpp/modality/fresh-text-requests.jsonl | 229.0 KB | jsonl | download |
| mgsm/fact_check/fresh-mgsm.jsonl | 1.2 MB | jsonl | download |
| minicheck/hallucination/dev.jsonl | 246.0 KB | jsonl | download |
| minicheck/hallucination/test.jsonl | 678.7 KB | jsonl | download |
| minicheck/hallucination/train.jsonl | 4.9 MB | jsonl | download |
| mintaka/fact_check/fresh-mintaka.jsonl | 654.0 KB | jsonl | download |
| mlcommons-synth/hazard/hold-mlcommons-synth.jsonl | 708.9 KB | jsonl | download |
| mmlu-cf/domain/hold-mmlu-cf.jsonl | 785.3 KB | jsonl | download |
| mmlu-pro/domain/hold-mmlu-pro.jsonl | 1.0 MB | jsonl | download |
| mmlu-prox/domain/hold-mmlu-prox.jsonl | 1.2 MB | jsonl | download |
| mt-bench-101/feedback/dev.jsonl | 6.4 KB | jsonl | download |
| mt-bench-101/feedback/test.jsonl | 14.8 KB | jsonl | download |
| mt-bench-101/feedback/train.jsonl | 127.6 KB | jsonl | download |
| nemotron-pii/pii/dev.jsonl | 386.8 KB | jsonl | download |
| nemotron-pii/pii/test.jsonl | 686.0 KB | jsonl | download |
| nemotron-pii/pii/train.jsonl | 9.2 MB | jsonl | download |
| nemotron-v3/hazard/dev.jsonl | 301.9 KB | jsonl | download |
| nemotron-v3/hazard/test-nemotron-v3.jsonl | 1.0 MB | jsonl | download |
| nemotron-v3/hazard/test.jsonl | 745.7 KB | jsonl | download |
| nemotron-v3/hazard/train.jsonl | 8.9 MB | jsonl | download |
| nemotron-v3/safety/dev.jsonl | 127.8 KB | jsonl | download |
| nemotron-v3/safety/test-nemotron-v3.jsonl | 993.6 KB | jsonl | download |
| nemotron-v3/safety/test.jsonl | 332.0 KB | jsonl | download |
| nemotron-v3/safety/train.jsonl | 8.9 MB | jsonl | download |
| nf-cats/fact_check/dev.jsonl | 7.7 KB | jsonl | download |
| nf-cats/fact_check/test.jsonl | 27.3 KB | jsonl | download |
| nf-cats/fact_check/train.jsonl | 143.5 KB | jsonl | download |
| no_robots/fact_check/hold-no_robots.jsonl | 1.5 MB | jsonl | download |
| notinject/jailbreak/hold-notinject.jsonl | 139.1 KB | jsonl | download |
| nym/pii/dev.jsonl | 176.6 KB | jsonl | download |
| nym/pii/test.jsonl | 271.8 KB | jsonl | download |
| nym/pii/train.jsonl | 4.0 MB | jsonl | download |
| oneig-zh/modality/fresh-oneig-zh.jsonl | 663.8 KB | jsonl | download |
| open-question-type/fact_check/dev.jsonl | 12.9 KB | jsonl | download |
| open-question-type/fact_check/test.jsonl | 42.6 KB | jsonl | download |
| open-question-type/fact_check/train.jsonl | 285.4 KB | jsonl | download |
| openai-moderation/safety/hold-openai-moderation.jsonl | 1.3 MB | jsonl | download |
| orbench-hard/safety/hold-orbench-hard.jsonl | 558.4 KB | jsonl | download |
| orbench/safety/dev.jsonl | 5.3 KB | jsonl | download |
| orbench/safety/test.jsonl | 9.8 KB | jsonl | download |
| orbench/safety/train.jsonl | 261.4 KB | jsonl | download |
| parti/modality/hold-parti.jsonl | 529.8 KB | jsonl | download |
| pii-prompts/pii/hold-pii-prompts.jsonl | 1.6 MB | jsonl | download |
| pii-trace/pii/fresh-pii-trace.jsonl | 821.9 KB | jsonl | download |
| polyguardprompts/safety/test-polyguardprompts.jsonl | 1.8 MB | jsonl | download |
| prompt-dump/modality/dev.jsonl | 61.8 KB | jsonl | download |
| prompt-dump/modality/test.jsonl | 109.1 KB | jsonl | download |
| prompt-dump/modality/train.jsonl | 2.1 MB | jsonl | download |
| prompts-chat/jailbreak/train-additions.jsonl | 1.3 MB | jsonl | download |
| promptshield-test/jailbreak/hold-promptshield-test.jsonl | 1.9 MB | jsonl | download |
| psiloqa/hallucination/dev.jsonl | 421.6 KB | jsonl | download |
| psiloqa/hallucination/test-psiloqa.jsonl | 1.6 MB | jsonl | download |
| psiloqa/hallucination/test.jsonl | 1.0 MB | jsonl | download |
| psiloqa/hallucination/train.jsonl | 8.9 MB | jsonl | download |
| ragbench/hallucination/dev.jsonl | 227.1 KB | jsonl | download |
| ragbench/hallucination/test-ragbench.jsonl | 3.1 MB | jsonl | download |
| ragbench/hallucination/test.jsonl | 662.6 KB | jsonl | download |
| ragbench/hallucination/train.jsonl | 6.1 MB | jsonl | download |
| ragtruth/hallucination/dev.jsonl | 264.2 KB | jsonl | download |
| ragtruth/hallucination/test-ragtruth.jsonl | 4.2 MB | jsonl | download |
| ragtruth/hallucination/test.jsonl | 560.4 KB | jsonl | download |
| ragtruth/hallucination/train.jsonl | 4.2 MB | jsonl | download |
| realedit/modality/dev.jsonl | 107.4 KB | jsonl | download |
| realedit/modality/test-realedit.jsonl | 762.9 KB | jsonl | download |
| realedit/modality/test.jsonl | 239.6 KB | jsonl | download |
| realedit/modality/train.jsonl | 4.5 MB | jsonl | download |
| refchecker/hallucination/test.jsonl | 6.2 KB | jsonl | download |
| refchecker/hallucination/train.jsonl | 94.8 KB | jsonl | download |
| ru-pii/pii/fresh-ru-pii.jsonl | 857.9 KB | jsonl | download |
| salad/jailbreak/dev.jsonl | 58.3 KB | jsonl | download |
| salad/jailbreak/test.jsonl | 296.3 KB | jsonl | download |
| salad/jailbreak/train.jsonl | 1.4 MB | jsonl | download |
| satml-ctf/jailbreak/train-additions.jsonl | 1.3 MB | jsonl | download |
| search-arena/fact_check/dev.jsonl | 31.6 KB | jsonl | download |
| search-arena/fact_check/test.jsonl | 138.5 KB | jsonl | download |
| search-arena/fact_check/train.jsonl | 941.7 KB | jsonl | download |
| search-arena/modality/hold-search-arena.jsonl | 895.6 KB | jsonl | download |
| sep/jailbreak/fresh-sep.jsonl | 1.3 MB | jsonl | download |
| sgd/feedback/dev.jsonl | 113.7 KB | jsonl | download |
| sgd/feedback/test-sgd.jsonl | 542.7 KB | jsonl | download |
| sgd/feedback/test.jsonl | 260.6 KB | jsonl | download |
| sgd/feedback/train.jsonl | 3.7 MB | jsonl | download |
| shipped-factcheck/fact_check/hold-shipped-factcheck.jsonl | 870.2 KB | jsonl | download |
| shipped-feedback/feedback/hold-shipped-feedback.jsonl | 645.8 KB | jsonl | download |
| shroom/hallucination/fresh-shroom.jsonl | 286.7 KB | jsonl | download |
| simpleqa/fact_check/hold-simpleqa.jsonl | 692.6 KB | jsonl | download |
| stackexchange/domain/dev.jsonl | 599.3 KB | jsonl | download |
| stackexchange/domain/test.jsonl | 1.2 MB | jsonl | download |
| 50 more files in text on Hugging Face ↗ | |||
tools/ 1 file 4.1 KB
| manifest.py | 4.1 KB | py | download |
No file list for this dataset yet.
This repository is private or no longer exists on Hugging Face.
Open on Hugging Face ↗No README stored for this dataset yet.