README.md

# Student Simulation v2

Quick reference. See `runall.sh` for the full pipeline.

## 关键变更（v2 vs v1）

1. **公式语义**: `x_new = x - (1 - α) · P · h`，α=1 不变，α=0 完全压制
2. **Sweep 范围**: α ∈ [0, 1]（v1 范围越界导致崩溃伪迹）
3. **方向版本**: 只保留 `v1_raw` 和新版 `v_pca_subspace`（k=3 子空间）
4. **新功能**: `JointResidualSteerer` 防止跨维度代偿
5. **新指标**: `count_real_monitoring()` 区分真反思和填充词
6. **新指标**: `is_collapsed()` 用 4-gram 重复 + 长度比，比 v1 更稳
7. **08b**: attention 输出诊断（informational only）
8. **10_infer**: 加入 runall 作为 sanity check
9. **删除**: LLM rater (11_llm_quality_rating.py)

## 用法

```bash
# 单卡完整跑
bash runall.sh

# 启用 anti-leak joint steering
JOINT=1 bash runall.sh

# 只跑某些 stage
STAGES=8,8b,9,10 bash runall.sh

# 只对一个题做 inference
python scripts/10_infer.py --dim planning --alphas 1.0 0.5 0.0 \
    --problem "Find x such that x^2=49"
```

## 目录

```
data/
  models/                                # Qwen3-30B-A3B-Thinking-2507
  cots/                                  # raw + labeled CoTs
  routing/                               # router top-k dumps
  activations/                           # decision-point residuals
  checkpoints/
    planning_v1_raw.pt
    planning_v_pca_subspace.pt           # 新版 k=3 子空间
    monitoring_v1_raw.pt
    monitoring_v_pca_subspace.pt
  results/
    sweep_log.jsonl                      # 含 steered_text
    final_report.md
    attention_diagnostic.{json,png}      # 新
    infer_sanity_planning.json           # 新
    infer_sanity_monitoring.json         # 新
  logs/
```

## 关键 config (`configs/model.py`)

```python
ALPHA_SWEEP        = [0.0, 0.1, 0.2, 0.3, 0.5, 0.75, 1.0]
DIRECTION_VERSIONS = ["v1_raw", "v_pca_subspace"]
PCA_SUBSPACE_K     = 3
ANTI_LEAK_BETA     = 0.3
GEN_CONFIG["max_new_tokens"]      = 12000  # 之前 4096 太小
GEN_CONFIG_FAST["max_new_tokens"] =  8192  # 之前 1024 太小
```