license: mit
pretty_name: meta-token generation-steering cache
tags:
- interpretability
- activation-steering
- qwen
- gemma
Generation-steering result cache for notebooks/wssteer.py
Everything the steer_generation dashboard of
zach-perlman/meta-token-analysis reads at
click time, so a fresh clone gets instant results for every library prompt × model without a GPU:
| path | what | regenerable? |
|---|---|---|
runs/<hash>.parquet + .json |
one file pair per (kind, model, prompt, resolved config, directions): every rollout with its judge letter; the sidecar holds the config and provenance | GPU hours |
alpha_by_model.json |
the calibrated per-layer dose α* per model, with the full dose curve and the criterion (calibrate_alpha) |
from runs/ |
prep/<hash>.pkl |
pickled Prepared (templated prompt, salient layers, token ids) per model × prompt — lets Check salience run without loading the model |
seconds, needs the model |
d12_pairs_<model>_<format>.pt |
D12 pair residuals used to build the d_amb / shuffled directions (≈ 930 MB) |
minutes, needs the model |
precompute*.log |
logs of the pre-run passes (provenance) | — |
The parquet/json pairs and alpha_by_model.json are also committed in the GitHub repo; the
rest is only here.
Restore
hf download zachperlman20/meta-token-gen-steer-cache --type dataset --local-dir results/gen_steer_cache
Contents as of 2026-09-10
9 models (Qwen3.8-27B, Qwen3.5-0.8B/2B/4B/9B, Gemma-4-E2B/E4B/12B/31B) × 37 library prompts ×
5 conditions (baseline, v_token, d_amb, random, shuffled) × 8 rollouts at each model's
α*, non-thinking, model-card sampling, all judged by Qwen3.8-27B (A/B/C/D + R for refusals);
plus the calibration dose sweeps (2 prompts × 7 doses × 3 directions × 4 rollouts per model).
Calibrated doses: 27B 0.02 · 0.8B 0.05 · 2B 0.05 · 4B 0.03 · 9B 0.03 · E2B 0.03 · E4B 0.03 ·
12B 0.02 · 31B 0.03.
Rows are re-scored on load by wssteer.score (regexes, end-of-turn cut, refusal override), so the
stored degenerate / wordplay / confused columns reflect the code version that wrote them;judge letters are as graded.