# Student Simulation v2 Quick reference. See `runall.sh` for the full pipeline. ## 关键变更(v2 vs v1) 1. **公式语义**: `x_new = x - (1 - α) · P · h`,α=1 不变,α=0 完全压制 2. **Sweep 范围**: α ∈ [0, 1](v1 范围越界导致崩溃伪迹) 3. **方向版本**: 只保留 `v1_raw` 和新版 `v_pca_subspace`(k=3 子空间) 4. **新功能**: `JointResidualSteerer` 防止跨维度代偿 5. **新指标**: `count_real_monitoring()` 区分真反思和填充词 6. **新指标**: `is_collapsed()` 用 4-gram 重复 + 长度比,比 v1 更稳 7. **08b**: attention 输出诊断(informational only) 8. **10_infer**: 加入 runall 作为 sanity check 9. **删除**: LLM rater (11_llm_quality_rating.py) ## 用法 ```bash # 单卡完整跑 bash runall.sh # 启用 anti-leak joint steering JOINT=1 bash runall.sh # 只跑某些 stage STAGES=8,8b,9,10 bash runall.sh # 只对一个题做 inference python scripts/10_infer.py --dim planning --alphas 1.0 0.5 0.0 \ --problem "Find x such that x^2=49" ``` ## 目录 ``` data/ models/ # Qwen3-30B-A3B-Thinking-2507 cots/ # raw + labeled CoTs routing/ # router top-k dumps activations/ # decision-point residuals checkpoints/ planning_v1_raw.pt planning_v_pca_subspace.pt # 新版 k=3 子空间 monitoring_v1_raw.pt monitoring_v_pca_subspace.pt results/ sweep_log.jsonl # 含 steered_text final_report.md attention_diagnostic.{json,png} # 新 infer_sanity_planning.json # 新 infer_sanity_monitoring.json # 新 logs/ ``` ## 关键 config (`configs/model.py`) ```python ALPHA_SWEEP = [0.0, 0.1, 0.2, 0.3, 0.5, 0.75, 1.0] DIRECTION_VERSIONS = ["v1_raw", "v_pca_subspace"] PCA_SUBSPACE_K = 3 ANTI_LEAK_BETA = 0.3 GEN_CONFIG["max_new_tokens"] = 12000 # 之前 4096 太小 GEN_CONFIG_FAST["max_new_tokens"] = 8192 # 之前 1024 太小 ```