license: apache-2.0
language:
- en
task_categories: - text-classification
- text-generation
tags: - trust-and-safety
- moderation
- pii-redaction
- governed-ai
- reason-codes
pretty_name: Trust and Safety Action Routing
size_categories: - n<1K
Trust and Safety Action Routing
This dataset evaluates moderation behavior for UGC, marketplaces, direct
messages, and moderation queues. It focuses on action routing: rewrite hostile
or policy-violating content, redact PII, refuse coordinated abuse, escalate
credible threats, and test shadow-mode rollout.
The dataset reflects a practical trust and safety requirement: platforms often
need an action and a reason code, not just a harmful/not-harmful label.
Intended Use
- Test whether moderation systems can choose allow, rewrite, redact, refuse, or
escalate outcomes. - Generate baseline evidence for policy-as-code enforcement and audit logging.
- Validate safer communication behavior without storing raw personal data.
Abliteration Baseline
python3 evals/governed-ai/scripts/run_policy_gateway_eval.py \
--dataset evals/governed-ai/datasets/trust_safety_action_routing.jsonl
Limitations
This dataset is deliberately small and synthetic. It should be extended with
platform-specific policy categories, locale coverage, appeals workflows, and
human-review outcomes before production use.