pretty_name: Qwen3 Multilingual Safety Evaluation
language:
- en
- sw
- kik
license: cc-by-4.0
task_categories: - text-generation
tags: - ai-safety
- multilingual
- evaluation
- african-languages
- qwen3
Qwen3 Multilingual Safety Evaluation
An exploratory evaluation of Qwen3-4B safety behavior across English, Kiswahili, and Kikuyu.
The dataset contains prompts covering harmful requests, benign educational and defensive questions, and ambiguous scenarios involving phishing, fraud, privacy, account access, and cybersecurity.
Dataset Structure
The responses.jsonl file contains model prompts and generated responses, alongside metadata such as language, risk category, expected behavior, and generation errors.
Intended Use
This dataset supports research into multilingual AI safety, particularly whether safety behavior remains consistent across English and underrepresented African languages.
Limitations
This is a small, exploratory evaluation, not a comprehensive safety benchmark. Kikuyu prompts require fluent-speaker validation, and model responses require human review before drawing conclusions. Expected behaviors are evaluation targets, not verified labels.
Model
- Model:
Qwen/Qwen3-4B - Precision: FP16
- Thinking mode: Disabled
- Generation: Greedy decoding
- Maximum output: 100 new tokens per response