| # Overlap-arch 1e18-g3 promotion cells (orch 0150/0160). V1 early-router only (V2 failed the 1e17 gate). | |
| # Exact flame38m 1e18 config: GRAIN=3 (192 exp/top-18), H256/L9 (moe-layer-freq [0]*1+[1]*8 = 8 MoE layers), | |
| # gb1024/mb32/2121it/seed1234/WSD, pythia-50k. BPB = test_CE / 2.9780, LOWER better. | |
| # Standard-arch 1e18-g3 comparators (seed1234): temporal 1.3354 (CE 3.976762), moe 1.3461 (CE 4.008667). | |
| # FLAG: the 1e17-s2 (L=6, 5 MoE layers) screen predicted early-router tax +0.0036 (temporal); the 1e18-flame38m | |
| # (L=9, 8 MoE layers) MEASUREMENT is far larger -> the screen did NOT transfer across depth. moe cell pending. | |
| variant,cell,method,test_ce_nats,test_bpb,std_bpb,delta,screen_predicted | |
| v1_early_router,flame38m_g3_temporal_ovlEarly,temporal,4.108881,1.3798,1.3354,+0.0444,+0.0036 | |
| v1_early_router,flame38m_g3_moe_ovlEarly,moe,4.456250,1.4964,1.3461,+0.1503,+0.0004 | |
| # VERDICT: V1 early-router FAILS at 1e18 depth on BOTH legs, far beyond the 1e17 screen's prediction. | |
| # temporal +0.0444 (screen said +0.0036, 12x) moe +0.1503 (screen said +0.0004, 375x) | |
| # The MoE leg is now WORSE THAN THE DENSE FLOOR (1.4964 vs 1.3911). Clean converged runs (no nan/skips). | |
| # => this is a DEPTH effect, not temporal-specific: the 1e17 screen was s2 (L=6, 5 MoE layers), the 1e18 | |
| # cell is flame38m (L=9, 8 MoE layers); pre-attention routing degrades compound per MoE layer, and the | |
| # free-MoE leg (which re-routes every layer with no residency smoothing) is hurt worst. | |
| # => the screen->promotion protocol must screen AT THE DEPLOYMENT DEPTH. V1 should not have promoted. | |