license: apache-2.0
task_categories:

• text-generation
  language:
• en
  tags:
• interpretability
• ai-safety
• refusal-direction
• abliteration
• agentic-safety
• research
  pretty_name: Qwen3.8-27B refusal-ablation — 2026-09-26 judged re-run artifacts

Qwen3.8-27B refusal-ablation — 2026-09-26 judged re-run: research artifacts

Everything except the weights from the 2026-09-26 re-run of a Qwen3.8-27B refusal-direction
ablation study: the layer-46 direction re-extraction, the LLM-judge-scored (+ human-adjudicated)
layer/alpha selection at 2048-token generation length, the full α ladder (0 / 0.25 / 0.5 / 0.75 /
1.0) evaluated on a held-out 50+50 prompt set, an agentic scenario ladder (A/B/C × permit/no-permit,
English + Korean), judge caches, and the pipeline source used to produce all of it.

This re-run exists because an earlier (2026-09-16) pass selected layers/alphas using 512-token,
substring-matched refusal scoring, which overcounts bypass on generations that get cut off
mid-hedge. This run uses 2048-token generations and an LLM-judge ensemble
(gpt-5.6-terra + claude-haiku-4-5-20251001) instead, with human labels filling in judge-rejected
calls.

Weights for the four α arms (α=0 is byte-identical to stock Qwen3.8-27B and not re-hosted):

• jhk0317/Qwen3.8-27B-refusal-ablation-L46-a0.25
• jhk0317/Qwen3.8-27B-refusal-ablation-L46-a0.5
• jhk0317/Qwen3.8-27B-refusal-ablation-L46-a0.75
• jhk0317/Qwen3.8-27B-refusal-ablation-L46-a1.0

Base model: Qwen/Qwen3.8-27B (Apache-2.0).

What's in here

• run/qwen38_ablj/ — the run's raw working directory: select.log, v_ref.select.json (layer
  selection), v_ref.select.generations.jsonl / .reasoning.jsonl (select-time generations),
  eval/ (per-alpha eval_a*.jsonl + reasoning_a*.jsonl + judge outputs), judge/ (judge
  response caches, keyed by prompt+model), human/ (queue.jsonl of judge-rejected calls sent for
  human labeling, labels.jsonl of the resulting labels), ckpt/*/abliteration.json (per-alpha edit
  metadata: direction, layer, orthogonalized modules — infra hostnames redacted to <GPU_HOST>),
  ckpt/SHA256SUMS, plus pipeline logs (pipeline.log, apply.log, extract.log, probe.log).
• run/qwen38_ablj_records.json — the model registry entries for the qwen38-27b-ablj-l46-a* arms
  (weight hashes, environment, serving config).
• run/qwen38_ablj_select_judge.json — the judge-scored layer selection summary that picked L46.
• run/qwen38_ablj_ladder_tables.md — rendered result tables for the full scenario ladder.
• run/qwen_ablj_ladder.log — the ladder run's full log.
• scenario_csv/{csv,scenario_b,scenario_c/default}[/en]/qwen38-27b-ablj-l46-a*.csv (+
  .reasoning.jsonl) — per-scenario (A/B/C), per-language (Korean default, English in en/),
  per-alpha agentic harness results: 10 trials per condition, traced, judge-scored.
• code/ — the pipeline source (extraction, application, selection, eval, harness, judging, S3/HF
  registration). AWS account ID, bucket name, and GPU host IPs are redacted to
  <AWS_ACCOUNT> / <MODEL_STORE_BUCKET> / <GPU_HOST>; no credentials are stored in these files —
  connect.sh mints short-lived scoped AWS credentials at runtime rather than embedding any.

This is the artifact set for the 2026-09-26 run only. It does not include the original 2026-09-16
run's data (that was a separate release).

License

Apache-2.0, inherited from the base model. See LICENSE.

Citation / context

Part of an ongoing interpretability study into how a single linear direction mediates refusal
behavior in Qwen3.8-27B, and how robust that behavior is to ablating it at different scales.