stationhouse

sae-64k / sae-128k probes (2026-11-06)

Width probes for the Marin-32B neuron-atlas SAE lane: layers 45/57/63 at width 65536 (sae-64k/) and 131072 (sae-128k/), trained from the shared sbg5 A100 lane. Each layer dir holds final + plateau checkpoints, census.parquet, stats.json, train/val logs, sha256.txt (mid-step checkpoints excluded per retention policy). Width verdict: 64k adopted for the full sweep; 128k stopped (median val gain 0.0044 < 0.02). sae-64k/layer=NN also carries the ongoing full-sweep finals.