Use absolute regime names for streaming reports

docs/formula_coefficient_methodology.md

@@ -706,16 +706,13 @@ static-to-streaming correction offline and backtest it on saved results.
 The active proof artifact is:
 
 ```text
-docs/streaming_multiseed_validation_report.md
-runs/streaming_tinystories_multiseed_validation_l12/combined_3seed_summary/
+docs/tinystories_streaming_report.md
+runs/streaming_tinystories_multiseed_validation_l12/combined_5seed_summary/
 ```
 
-If we want paper-grade confidence for TinyStories, the next experiment should:
-
-1. add seeds `4` and `5`;
-2. keep the same model, stream prefixes, and six conditions;
-3. regenerate the combined streaming report at `n=5`;
-4. use that report as the main TinyStories evidence.
+TinyStories has already been regenerated at `n=5`. The next paper-grade
+streaming validation target is WikiText-103, after reconciling the TinyStories
+and OpenWebText10K reports.
 
 For any later regime, repeat the same pattern: first use static backtests to
 choose coefficients, then create a streaming multi-seed validation report as the

docs/{previous_regime_streaming_report.md → openwebtext10k_streaming_report.md}

@@ -1,4 +1,4 @@
-# Previous/Local Regime Streaming Validation
+# OpenWebText10K Streaming Validation
 
 Date: 2026-05-30
 
@@ -6,17 +6,21 @@ This report combines 5 random seeds (1, 2, 3, 4, 5) from saved streaming runs.
 No additional training is performed by this script; it reads saved
 `metrics.jsonl` files.
 
-Regime: original/local saved streaming setup with L16_H8_D384, 31,457,280 parameters, five prefixes from 250k to 4M tokens, and 1,000 optimizer steps per stage. This is a clean five-seed run including the updated previous/local interaction formula schedule, empirical decay schedules, and static baselines.
+Regime: OpenWebText10K cached-corpus streaming setup with L16_H8_D384,
+31,457,280 parameters, five prefixes from 250k to 4M tokens, and 1,000
+optimizer steps per stage. This is a clean five-seed run including the
+OpenWebText10K interaction schedule, empirical decay schedules, and static
+baselines.
 
 ## Sources
 
-- `runs/previous_local_updated_formula_clean_l16/locked_stream/20260530-174525/metrics.jsonl`
+- `runs/openwebtext10k_l16_updated_formula_clean_5seed/locked_stream/20260530-174525/metrics.jsonl`
 
 ## Condition Ranking By Final Loss
 
 | Condition | Kind | N | Mean trajectory val | Std trajectory val | Mean final val | Std final val | Mean final gap | Dropout path |
 |---|---|---:|---:|---:|---:|---:|---:|---|
-| `prevlocal_interaction` | `anchor_decay` | 5 | 4.8609 | 0.0046 | 4.3981 | 0.0095 | 0.3177 | `0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07` |
+| `openwebtext10k_interaction` | `anchor_decay` | 5 | 4.8609 | 0.0046 | 4.3981 | 0.0095 | 0.3177 | `0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07` |
 | `hold_30_then_decay` | `anchor_decay` | 5 | 4.8512 | 0.0017 | 4.4052 | 0.0112 | 0.3565 | `0.30 -> 0.30 -> 0.20 -> 0.10 -> 0.02` |
 | `mild_30_to_08` | `anchor_decay` | 5 | 4.8509 | 0.0015 | 4.4073 | 0.0085 | 0.3337 | `0.30 -> 0.24 -> 0.18 -> 0.12 -> 0.08` |
 | `fitted_l16_static_law` | `anchor_decay` | 5 | 4.9521 | 0.0039 | 4.4124 | 0.0084 | 0.3137 | `0.60 -> 0.40 -> 0.30 -> 0.14 -> 0.02` |
@@ -32,7 +36,7 @@ baseline for that seed.
 
 | Seed | Condition | Final val | Best static | Best static final val | Delta vs best static |
 |---:|---|---:|---|---:|---:|
-| 1 | `prevlocal_interaction` | 4.4023 | `static_dropout_0.14` | 4.4418 | -0.0394 |
+| 1 | `openwebtext10k_interaction` | 4.4023 | `static_dropout_0.14` | 4.4418 | -0.0394 |
 | 1 | `hold_30_then_decay` | 4.3939 | `static_dropout_0.14` | 4.4418 | -0.0479 |
 | 1 | `mild_30_to_08` | 4.3995 | `static_dropout_0.14` | 4.4418 | -0.0423 |
 | 1 | `fitted_l16_static_law` | 4.4207 | `static_dropout_0.14` | 4.4418 | -0.0211 |
@@ -40,7 +44,7 @@ baseline for that seed.
 | 1 | `static_dropout_0.3` | 4.4602 | `static_dropout_0.14` | 4.4418 | +0.0184 |
 | 1 | `static_dropout_0.02` | 4.5402 | `static_dropout_0.14` | 4.4418 | +0.0984 |
 | 1 | `static_dropout_0` | 4.5704 | `static_dropout_0.14` | 4.4418 | +0.1286 |
-| 2 | `prevlocal_interaction` | 4.4020 | `static_dropout_0.14` | 4.4602 | -0.0583 |
+| 2 | `openwebtext10k_interaction` | 4.4020 | `static_dropout_0.14` | 4.4602 | -0.0583 |
 | 2 | `hold_30_then_decay` | 4.4068 | `static_dropout_0.14` | 4.4602 | -0.0534 |
 | 2 | `mild_30_to_08` | 4.4080 | `static_dropout_0.14` | 4.4602 | -0.0522 |
 | 2 | `fitted_l16_static_law` | 4.4136 | `static_dropout_0.14` | 4.4602 | -0.0466 |
@@ -48,7 +52,7 @@ baseline for that seed.
 | 2 | `static_dropout_0.3` | 4.4719 | `static_dropout_0.14` | 4.4602 | +0.0117 |
 | 2 | `static_dropout_0.02` | 4.5466 | `static_dropout_0.14` | 4.4602 | +0.0864 |
 | 2 | `static_dropout_0` | 4.6094 | `static_dropout_0.14` | 4.4602 | +0.1492 |
-| 3 | `prevlocal_interaction` | 4.4029 | `static_dropout_0.14` | 4.4356 | -0.0328 |
+| 3 | `openwebtext10k_interaction` | 4.4029 | `static_dropout_0.14` | 4.4356 | -0.0328 |
 | 3 | `hold_30_then_decay` | 4.4174 | `static_dropout_0.14` | 4.4356 | -0.0183 |
 | 3 | `mild_30_to_08` | 4.4151 | `static_dropout_0.14` | 4.4356 | -0.0206 |
 | 3 | `fitted_l16_static_law` | 4.4134 | `static_dropout_0.14` | 4.4356 | -0.0223 |
@@ -56,7 +60,7 @@ baseline for that seed.
 | 3 | `static_dropout_0.3` | 4.4758 | `static_dropout_0.14` | 4.4356 | +0.0401 |
 | 3 | `static_dropout_0.02` | 4.5345 | `static_dropout_0.14` | 4.4356 | +0.0988 |
 | 3 | `static_dropout_0` | 4.5928 | `static_dropout_0.14` | 4.4356 | +0.1571 |
-| 4 | `prevlocal_interaction` | 4.3811 | `static_dropout_0.14` | 4.4337 | -0.0526 |
+| 4 | `openwebtext10k_interaction` | 4.3811 | `static_dropout_0.14` | 4.4337 | -0.0526 |
 | 4 | `hold_30_then_decay` | 4.3936 | `static_dropout_0.14` | 4.4337 | -0.0400 |
 | 4 | `mild_30_to_08` | 4.3978 | `static_dropout_0.14` | 4.4337 | -0.0359 |
 | 4 | `fitted_l16_static_law` | 4.3983 | `static_dropout_0.14` | 4.4337 | -0.0354 |
@@ -64,7 +68,7 @@ baseline for that seed.
 | 4 | `static_dropout_0.3` | 4.4455 | `static_dropout_0.14` | 4.4337 | +0.0118 |
 | 4 | `static_dropout_0.02` | 4.5220 | `static_dropout_0.14` | 4.4337 | +0.0883 |
 | 4 | `static_dropout_0` | 4.5768 | `static_dropout_0.14` | 4.4337 | +0.1432 |
-| 5 | `prevlocal_interaction` | 4.4024 | `static_dropout_0.14` | 4.4560 | -0.0536 |
+| 5 | `openwebtext10k_interaction` | 4.4024 | `static_dropout_0.14` | 4.4560 | -0.0536 |
 | 5 | `hold_30_then_decay` | 4.4145 | `static_dropout_0.14` | 4.4560 | -0.0415 |
 | 5 | `mild_30_to_08` | 4.4161 | `static_dropout_0.14` | 4.4560 | -0.0399 |
 | 5 | `fitted_l16_static_law` | 4.4161 | `static_dropout_0.14` | 4.4560 | -0.0399 |
@@ -81,27 +85,27 @@ baseline for that seed.
 | 0 | 250,000 | `hold_30_then_decay` | 0.300 | 5 | 5.4483 | 0.0138 | 4.4429 | 1.0054 |
 | 0 | 250,000 | `static_dropout_0.3` | 0.300 | 5 | 5.4483 | 0.0138 | 4.4429 | 1.0054 |
 | 0 | 250,000 | `static_dropout_0.14` | 0.140 | 5 | 5.4773 | 0.0224 | 4.0298 | 1.4475 |
-| 0 | 250,000 | `prevlocal_interaction` | 0.385 | 5 | 5.4947 | 0.0109 | 4.6016 | 0.8930 |
+| 0 | 250,000 | `openwebtext10k_interaction` | 0.385 | 5 | 5.4947 | 0.0109 | 4.6016 | 0.8930 |
 | 0 | 250,000 | `static_dropout_0.02` | 0.020 | 5 | 5.7426 | 0.0242 | 3.5371 | 2.2055 |
 | 0 | 250,000 | `fitted_l16_static_law` | 0.600 | 5 | 5.7842 | 0.0096 | 5.1640 | 0.6202 |
 | 0 | 250,000 | `static_dropout_0` | 0.000 | 5 | 5.8330 | 0.0198 | 3.4443 | 2.3887 |
 | 1 | 500,000 | `mild_30_to_08` | 0.240 | 5 | 5.0582 | 0.0159 | 4.0349 | 1.0233 |
 | 1 | 500,000 | `static_dropout_0.3` | 0.300 | 5 | 5.0667 | 0.0173 | 4.1383 | 0.9284 |
 | 1 | 500,000 | `hold_30_then_decay` | 0.300 | 5 | 5.0667 | 0.0173 | 4.1383 | 0.9284 |
-| 1 | 500,000 | `prevlocal_interaction` | 0.319 | 5 | 5.0715 | 0.0118 | 4.2065 | 0.8650 |
+| 1 | 500,000 | `openwebtext10k_interaction` | 0.319 | 5 | 5.0715 | 0.0118 | 4.2065 | 0.8650 |
 | 1 | 500,000 | `static_dropout_0.14` | 0.140 | 5 | 5.1492 | 0.0070 | 3.7143 | 1.4349 |
 | 1 | 500,000 | `fitted_l16_static_law` | 0.400 | 5 | 5.1507 | 0.0102 | 4.4632 | 0.6875 |
 | 1 | 500,000 | `static_dropout_0.02` | 0.020 | 5 | 5.5754 | 0.0248 | 3.1246 | 2.4508 |
 | 1 | 500,000 | `static_dropout_0` | 0.000 | 5 | 5.7175 | 0.0502 | 2.9583 | 2.7592 |
 | 2 | 1,000,000 | `hold_30_then_decay` | 0.200 | 5 | 4.7757 | 0.0144 | 4.0378 | 0.7379 |
 | 2 | 1,000,000 | `mild_30_to_08` | 0.180 | 5 | 4.7774 | 0.0138 | 3.9886 | 0.7888 |
-| 2 | 1,000,000 | `prevlocal_interaction` | 0.227 | 5 | 4.7811 | 0.0084 | 4.0826 | 0.6984 |
+| 2 | 1,000,000 | `openwebtext10k_interaction` | 0.227 | 5 | 4.7811 | 0.0084 | 4.0826 | 0.6984 |
 | 2 | 1,000,000 | `static_dropout_0.3` | 0.300 | 5 | 4.7983 | 0.0144 | 4.1501 | 0.6481 |
 | 2 | 1,000,000 | `fitted_l16_static_law` | 0.300 | 5 | 4.8326 | 0.0102 | 4.2632 | 0.5694 |
 | 2 | 1,000,000 | `static_dropout_0.14` | 0.140 | 5 | 4.8490 | 0.0202 | 3.8712 | 0.9779 |
 | 2 | 1,000,000 | `static_dropout_0.02` | 0.020 | 5 | 5.1470 | 0.0222 | 3.4615 | 1.6854 |
 | 2 | 1,000,000 | `static_dropout_0` | 0.000 | 5 | 5.2637 | 0.0274 | 3.3260 | 1.9377 |
-| 3 | 2,000,000 | `prevlocal_interaction` | 0.139 | 5 | 4.5590 | 0.0142 | 4.0802 | 0.4788 |
+| 3 | 2,000,000 | `openwebtext10k_interaction` | 0.139 | 5 | 4.5590 | 0.0142 | 4.0802 | 0.4788 |
 | 3 | 2,000,000 | `hold_30_then_decay` | 0.100 | 5 | 4.5599 | 0.0161 | 4.0445 | 0.5154 |
 | 3 | 2,000,000 | `mild_30_to_08` | 0.120 | 5 | 4.5631 | 0.0155 | 4.0441 | 0.5190 |
 | 3 | 2,000,000 | `fitted_l16_static_law` | 0.140 | 5 | 4.5806 | 0.0153 | 4.1471 | 0.4334 |
@@ -109,7 +113,7 @@ baseline for that seed.
 | 3 | 2,000,000 | `static_dropout_0.14` | 0.140 | 5 | 4.6048 | 0.0136 | 4.0399 | 0.5648 |
 | 3 | 2,000,000 | `static_dropout_0.02` | 0.020 | 5 | 4.7847 | 0.0196 | 3.8405 | 0.9442 |
 | 3 | 2,000,000 | `static_dropout_0` | 0.000 | 5 | 4.8472 | 0.0171 | 3.7786 | 1.0687 |
-| 4 | 4,000,000 | `prevlocal_interaction` | 0.066 | 5 | 4.3981 | 0.0095 | 4.0805 | 0.3177 |
+| 4 | 4,000,000 | `openwebtext10k_interaction` | 0.066 | 5 | 4.3981 | 0.0095 | 4.0805 | 0.3177 |
 | 4 | 4,000,000 | `hold_30_then_decay` | 0.020 | 5 | 4.4052 | 0.0112 | 4.0488 | 0.3565 |
 | 4 | 4,000,000 | `mild_30_to_08` | 0.080 | 5 | 4.4073 | 0.0085 | 4.0736 | 0.3337 |
 | 4 | 4,000,000 | `fitted_l16_static_law` | 0.020 | 5 | 4.4124 | 0.0084 | 4.0987 | 0.3137 |
@@ -120,10 +124,10 @@ baseline for that seed.
 
 ## Interpretation
 
-- `prevlocal_interaction` has the best 5-seed mean final validation loss: 4.3981 +/- 0.0095.
+- `openwebtext10k_interaction` has the best 5-seed mean final validation loss: 4.3981 +/- 0.0095.
 - The second-best final condition is `hold_30_then_decay` at 4.4052 +/- 0.0112.
 - The best static baseline by mean final loss is `static_dropout_0.14` at 4.4455 +/- 0.0120.
-- `prevlocal_interaction` beats the per-seed best static baseline in 5/5 seeds; worst paired delta is -0.0328.
+- `openwebtext10k_interaction` beats the per-seed best static baseline in 5/5 seeds; worst paired delta is -0.0328.
 - `hold_30_then_decay` beats the per-seed best static baseline in 5/5 seeds; worst paired delta is -0.0183.
 - `mild_30_to_08` beats the per-seed best static baseline in 5/5 seeds; worst paired delta is -0.0206.
 - `fitted_l16_static_law` beats the per-seed best static baseline in 5/5 seeds; worst paired delta is -0.0211.

docs/plan.md

@@ -281,11 +281,11 @@ Use this order for every regime.
 
 | Regime | Status | Role |
 |---|---|---|
-| original/local saved regime | offline backtest complete | retrospective support for interaction pressure law; do not rerun unless necessary |
+| OpenWebText10K static/coefficient regime | offline backtest complete | retrospective support for interaction pressure law; do not rerun unless necessary |
 | TinyStories static/coefficient regime | active | main coefficient evidence |
 | TinyStories streaming regime | 5-seed validation complete | current main streaming evidence; interaction decay beats best static in 5/5 paired final-loss comparisons |
-| original/local streaming regime | 5-seed clean validation complete | previous/local interaction decay beats best static in 5/5 paired final-loss comparisons |
-| next new streaming regime | pending | start only after TinyStories and original/local streaming reports are reconciled |
+| OpenWebText10K streaming regime | 5-seed clean validation complete | OpenWebText10K interaction decay beats best static in 5/5 paired final-loss comparisons |
+| WikiText-103 streaming regime | pending | start only after TinyStories and OpenWebText10K streaming reports are reconciled |
 
 ## Current Formula Status
 
@@ -320,7 +320,7 @@ p_t = clamp(p_min, p_max,
 ```
 
 Use these only as the current TinyStories-regime coefficients. They are not
-assumed to transfer numerically to the original/local regime or any future
+assumed to transfer numerically to the OpenWebText10K regime or any future
 corpus regime. The cross-regime claim we are testing is that the pressure-law
 structure transfers, while coefficients may be regime-specific.
 
@@ -328,12 +328,12 @@ structure transfers, while coefficients may be regime-specific.
 
 | Evidence item | Current reading |
 |---|---|
-| original/local saved regime | backtest complete; interaction MAE `0.0148` on local+5M versus base ABC MAE `0.0389` |
+| OpenWebText10K static/coefficient regime | backtest complete; interaction MAE `0.0148` on OpenWebText10K+5M versus base ABC MAE `0.0389` |
 | TinyStories static optima | interaction form fits static dropout optima better than base ABC |
 | TinyStories held-out prefix | supports pressure dependence on unique tokens |
 | TinyStories held-out model | supports pressure dependence on model size |
 | TinyStories streaming, 5 seeds | interaction has best mean final loss; interaction beats best static in 5/5 paired final-loss comparisons |
-| previous/local streaming, 5 seeds | interaction decay has best mean final loss; top decay schedules beat best static in 5/5 paired comparisons |
+| OpenWebText10K streaming, 5 seeds | interaction decay has best mean final loss; top decay schedules beat best static in 5/5 paired comparisons |
 | cross-regime raw coefficient transfer | weaker than within-regime fit; supports regime-specific coefficients rather than universal numeric coefficients |
 
 Latest TinyStories 5-seed streaming final-loss table:
@@ -355,7 +355,7 @@ Paired final-loss result:
 | `baseabc` | 5/5 |
 | `smooth_low` | 4/5, with the one miss only `+0.0003` |
 
-The immediate risk is no longer seed count for TinyStories or previous/local.
+The immediate risk is no longer seed count for TinyStories or OpenWebText10K.
 The main remaining risk is external validity beyond two tested regimes. The
 current defensible claim is:
 
@@ -370,15 +370,15 @@ The stronger claim:
 Formula-derived dropout decay beats the best static dropout.
 ```
 
-is supported at `n=5` in both the TinyStories and previous/local streaming
+is supported at `n=5` in both the TinyStories and OpenWebText10K streaming
 setups, with interaction decay beating the per-seed best static baseline in all
 five seeds in both regimes.
 
-Latest previous/local 5-seed streaming final-loss table:
+Latest OpenWebText10K 5-seed streaming final-loss table:
 
 | Condition | Mean final 4M validation loss | Std |
 |---|---:|---:|
-| `prevlocal_interaction` decay | 4.3981 | 0.0095 |
+| `openwebtext10k_interaction` decay | 4.3981 | 0.0095 |
 | `hold_30_then_decay` | 4.4052 | 0.0112 |
 | `mild_30_to_08` | 4.4073 | 0.0085 |
 | `fitted_l16_static_law` | 4.4124 | 0.0084 |
@@ -391,14 +391,14 @@ Paired final-loss result:
 
 | Decay schedule | Paired wins vs best static |
 |---|---:|
-| `prevlocal_interaction` | 5/5 |
+| `openwebtext10k_interaction` | 5/5 |
 | `hold_30_then_decay` | 5/5 |
 | `mild_30_to_08` | 5/5 |
 | `fitted_l16_static_law` | 5/5 |
 
-The best static baseline in the clean previous/local run is static dropout
+The best static baseline in the clean OpenWebText10K run is static dropout
 `0.14`. The interaction schedule improves mean final validation loss by about
-`0.0473` and wins every paired seed comparison. This promotes previous/local
+`0.0473` and wins every paired seed comparison. This promotes OpenWebText10K
 from exploratory support to a second multi-seed streaming validation regime.
 
 ## Completed Static Backtest Gate
@@ -413,7 +413,7 @@ runs/coefficient_calibration/cross_regime_backtest/
 Main reading:
 
 ```text
-the interaction pressure-law structure is supported in both the previous local
+the interaction pressure-law structure is supported in both the OpenWebText10K
 regime and the current TinyStories regime, but coefficient values are
 regime-specific.
 ```
@@ -423,7 +423,7 @@ streaming multi-seed reports for each regime.
 
 ## Immediate Next Action
 
-Reconcile the TinyStories five-seed report and previous/local five-seed report
+Reconcile the TinyStories five-seed report and OpenWebText10K five-seed report
 into the paper outline. The seed-count gap is now closed. The next empirical
 weakness is external validity, so the preferred next experiment is a third
 held-out regime with minimal coefficient calibration followed by narrowed
@@ -432,12 +432,12 @@ multi-seed streaming validation.
 ## Next Training After Current Gate
 
 No MPS training should launch until the two completed five-seed streaming
-reports are read together. Since previous/local seed count is no longer the
+reports are read together. Since OpenWebText10K seed count is no longer the
 limiting issue, use a third held-out regime for the next validation step:
 
 ```text
 completed: TinyStories 5-seed streaming report
-completed: previous/local 5-seed clean streaming report
+completed: OpenWebText10K 5-seed clean streaming report
 next: third held-out regime with minimal calibration
 avoid: broad new sweep before cross-regime report reconciliation
 ```
@@ -452,7 +452,7 @@ decay minus best-static delta per seed
 rank consistency across seeds
 ```
 
-Because previous/local decay wins across paired seeds, promote the cross-regime
+Because OpenWebText10K decay wins across paired seeds, promote the cross-regime
 streaming claim to "supported in two regimes." Do not yet claim universal
 numeric coefficients. The next claim to test is whether the pressure-law
 structure and regime-specific fitting procedure reproduce the win in a third
@@ -461,8 +461,8 @@ held-out regime.
 Latest streaming report:
 
 ```text
-docs/streaming_multiseed_validation_report.md
-docs/previous_regime_streaming_report.md
+docs/tinystories_streaming_report.md
+docs/openwebtext10k_streaming_report.md
 runs/streaming_tinystories_multiseed_validation_l12/combined_5seed_summary/
-runs/previous_local_streaming_report/l16_updated_formula_clean_5seed/
+runs/openwebtext10k_streaming_report/l16_updated_formula_clean_5seed/
 ```

paper/dropout_decay_pressure_law.tex

@@ -242,7 +242,7 @@ falls as unique-token count grows and rises with model size at fixed prefix.
 
 \begin{table}[h]
 \centering
-\caption{Static dropout optima in the main local regime.}
+\caption{Static dropout optima in the OpenWebText10K cached-corpus regime.}
 \label{tab:static_screen}
 \resizebox{\textwidth}{!}{%
 \begin{tabular}{lrrrrrr}
@@ -417,7 +417,7 @@ identity can shift the optimum independently of the two pressure ratios.
 
 The evidence supports a pressure-law structure, not a universal coefficient
 triplet. The static fit shows that dropout optima can be approximated from
-$\log_{10}(\params/U)$ and $\log_{10}(C/U)$ within the local regime. The
+$\log_{10}(\params/U)$ and $\log_{10}(C/U)$ within the OpenWebText10K cached-corpus regime. The
 streaming experiments show that a schedule based on those variables can beat
 fixed dropout across model sizes and architecture-shape holdouts.
 

runs/coefficient_calibration/cross_regime_backtest/cross_regime_transfer.csv

@@ -1,7 +1,7 @@
 fit,test,feature_set,n,rmse,mae,bias
-previous_local_plus_5m_base,tinystories_all_base,base,16,0.07386955299897678,0.06472190875277323,0.03788621409309852
-tinystories_all_base,previous_local_plus_5m_base,base,18,0.06957982081354992,0.054804945072472085,-0.05140145139355316
-previous_local_plus_5m_interaction,tinystories_all_interaction,interaction,16,0.05329059269271824,0.043855722984289955,0.03858432254089361
-tinystories_all_interaction,previous_local_plus_5m_interaction,interaction,18,0.04900067592752971,0.04224224097829212,-0.02542907718141662
+openwebtext10k_plus_5m_base,tinystories_all_base,base,16,0.07386955299897678,0.06472190875277323,0.03788621409309852
+tinystories_all_base,openwebtext10k_plus_5m_base,base,18,0.06957982081354992,0.054804945072472085,-0.05140145139355316
+openwebtext10k_plus_5m_interaction,tinystories_all_interaction,interaction,16,0.05329059269271824,0.043855722984289955,0.03858432254089361
+tinystories_all_interaction,openwebtext10k_plus_5m_interaction,interaction,18,0.04900067592752971,0.04224224097829212,-0.02542907718141662
 pooled_previous_plus_corpus_probes_interaction,tinystories_all_interaction,interaction,16,0.054486145469252165,0.039881828643724325,0.034998333737162594
 tinystories_all_interaction,pooled_previous_plus_corpus_probes_interaction,interaction,21,0.057481960591220224,0.049286664509871674,-0.00871732248416439

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/RESULT_SUMMARY.md

@@ -1,6 +1,6 @@
 # Locked Streaming Dropout Summary
 
-Run directory: `runs/previous_local_updated_formula_clean_l16/locked_stream/20260530-174525`
+Run directory: `runs/openwebtext10k_l16_updated_formula_clean_5seed/locked_stream/20260530-174525`
 
 Model: `L16_H8_D384` causal Transformer, 31,457,280 parameters, 16 layers, 8 heads, 384 embedding dim.
 Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row. Seeds present: 1, 2, 3, 4, 5.
@@ -11,7 +11,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 |---|---|---:|---:|---:|---:|---|
 | `mild_30_to_08` | anchor_decay | 0.08 | 4.8509 | 4.4073 | 0.3337 | 0.30 -> 0.24 -> 0.18 -> 0.12 -> 0.08 |
 | `hold_30_then_decay` | anchor_decay | 0.02 | 4.8512 | 4.4052 | 0.3565 | 0.30 -> 0.30 -> 0.20 -> 0.10 -> 0.02 |
-| `prevlocal_interaction` | anchor_decay | 0.07 | 4.8609 | 4.3981 | 0.3177 | 0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07 |
+| `openwebtext10k_interaction` | anchor_decay | 0.07 | 4.8609 | 4.3981 | 0.3177 | 0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07 |
 | `static_dropout_0.3` | static | 0.30 | 4.8767 | 4.4668 | 0.2349 | 0.30 -> 0.30 -> 0.30 -> 0.30 -> 0.30 |
 | `static_dropout_0.14` | static | 0.14 | 4.9051 | 4.4455 | 0.3289 | 0.14 -> 0.14 -> 0.14 -> 0.14 -> 0.14 |
 | `fitted_l16_static_law` | anchor_decay | 0.02 | 4.9521 | 4.4124 | 0.3137 | 0.60 -> 0.40 -> 0.30 -> 0.14 -> 0.02 |
@@ -28,7 +28,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 | `hold_30_then_decay` | 0.30 | 5.4483 | 4.4429 | 1.0054 | 5 |
 | `static_dropout_0.3` | 0.30 | 5.4483 | 4.4429 | 1.0054 | 5 |
 | `static_dropout_0.14` | 0.14 | 5.4773 | 4.0298 | 1.4475 | 5 |
-| `prevlocal_interaction` | 0.39 | 5.4947 | 4.6016 | 0.8930 | 5 |
+| `openwebtext10k_interaction` | 0.39 | 5.4947 | 4.6016 | 0.8930 | 5 |
 | `static_dropout_0.02` | 0.02 | 5.7426 | 3.5371 | 2.2055 | 5 |
 | `fitted_l16_static_law` | 0.60 | 5.7842 | 5.1640 | 0.6202 | 5 |
 | `static_dropout_0` | 0.00 | 5.8330 | 3.4443 | 2.3887 | 5 |
@@ -40,7 +40,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 | `mild_30_to_08` | 0.24 | 5.0582 | 4.0349 | 1.0233 | 5 |
 | `static_dropout_0.3` | 0.30 | 5.0667 | 4.1383 | 0.9284 | 5 |
 | `hold_30_then_decay` | 0.30 | 5.0667 | 4.1383 | 0.9284 | 5 |
-| `prevlocal_interaction` | 0.32 | 5.0715 | 4.2065 | 0.8650 | 5 |
+| `openwebtext10k_interaction` | 0.32 | 5.0715 | 4.2065 | 0.8650 | 5 |
 | `static_dropout_0.14` | 0.14 | 5.1492 | 3.7143 | 1.4349 | 5 |
 | `fitted_l16_static_law` | 0.40 | 5.1507 | 4.4632 | 0.6875 | 5 |
 | `static_dropout_0.02` | 0.02 | 5.5754 | 3.1246 | 2.4508 | 5 |
@@ -52,7 +52,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 |---|---:|---:|---:|---:|---:|
 | `hold_30_then_decay` | 0.20 | 4.7757 | 4.0378 | 0.7379 | 5 |
 | `mild_30_to_08` | 0.18 | 4.7774 | 3.9886 | 0.7888 | 5 |
-| `prevlocal_interaction` | 0.23 | 4.7811 | 4.0826 | 0.6984 | 5 |
+| `openwebtext10k_interaction` | 0.23 | 4.7811 | 4.0826 | 0.6984 | 5 |
 | `static_dropout_0.3` | 0.30 | 4.7983 | 4.1501 | 0.6481 | 5 |
 | `fitted_l16_static_law` | 0.30 | 4.8326 | 4.2632 | 0.5694 | 5 |
 | `static_dropout_0.14` | 0.14 | 4.8490 | 3.8712 | 0.9779 | 5 |
@@ -63,7 +63,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 
 | Condition | Dropout | Mean val loss | Mean train loss | Mean gap | N |
 |---|---:|---:|---:|---:|---:|
-| `prevlocal_interaction` | 0.14 | 4.5590 | 4.0802 | 0.4788 | 5 |
+| `openwebtext10k_interaction` | 0.14 | 4.5590 | 4.0802 | 0.4788 | 5 |
 | `hold_30_then_decay` | 0.10 | 4.5599 | 4.0445 | 0.5154 | 5 |
 | `mild_30_to_08` | 0.12 | 4.5631 | 4.0441 | 0.5190 | 5 |
 | `fitted_l16_static_law` | 0.14 | 4.5806 | 4.1471 | 0.4334 | 5 |
@@ -76,7 +76,7 @@ Training per stage: 1,000 steps. Sampled tokens are cumulative in each stage row
 
 | Condition | Dropout | Mean val loss | Mean train loss | Mean gap | N |
 |---|---:|---:|---:|---:|---:|
-| `prevlocal_interaction` | 0.07 | 4.3981 | 4.0805 | 0.3177 | 5 |
+| `openwebtext10k_interaction` | 0.07 | 4.3981 | 4.0805 | 0.3177 | 5 |
 | `hold_30_then_decay` | 0.02 | 4.4052 | 4.0488 | 0.3565 | 5 |
 | `mild_30_to_08` | 0.08 | 4.4073 | 4.0736 | 0.3337 | 5 |
 | `fitted_l16_static_law` | 0.02 | 4.4124 | 4.0987 | 0.3137 | 5 |

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/config.json

@@ -5,7 +5,7 @@
     "corpus_glob": null,
     "text_column": "text",
     "use_cached_data": true,
-    "output_dir": "runs/previous_local_updated_formula_clean_l16",
+    "output_dir": "runs/openwebtext10k_l16_updated_formula_clean_5seed",
     "resume_from": null,
     "cache_dir": ".cache/dropout_decay",
     "models": [
@@ -46,7 +46,7 @@
     "decays": [],
     "anchor_decays": [
       {
-        "name": "prevlocal_interaction",
+        "name": "openwebtext10k_interaction",
         "kind": "anchor_decay",
         "initial": 0.385,
         "final": 0.066,

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/metrics.jsonl

@@ -1,28 +1,28 @@
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 145.00203609466553, "eval_loss": 5.500026352703571, "generalization_gap": 0.8845655247569084, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.615460827946663, "train_loss_last": 4.844176292419434, "val_eval_loss": 5.500026352703571}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 145.0216257572174, "eval_loss": 5.0825527757406235, "generalization_gap": 0.8991758674383163, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.183376908302307, "train_loss_last": 4.244839668273926, "val_eval_loss": 5.0825527757406235}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 148.04349493980408, "eval_loss": 4.776466831564903, "generalization_gap": 0.664736419916153, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.11173041164875, "train_loss_last": 4.434404373168945, "val_eval_loss": 4.776466831564903}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 154.4656720161438, "eval_loss": 4.57609198987484, "generalization_gap": 0.491582490503788, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.084509499371052, "train_loss_last": 4.123593330383301, "val_eval_loss": 4.57609198987484}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 156.33115100860596, "eval_loss": 4.402347795665264, "generalization_gap": 0.3080834597349167, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.094264335930347, "train_loss_last": 4.194511413574219, "val_eval_loss": 4.402347795665264}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 157.64197206497192, "eval_loss": 5.496512919664383, "generalization_gap": 0.8909523785114288, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.605560541152954, "train_loss_last": 4.836062908172607, "val_eval_loss": 5.496512919664383}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.58259201049805, "eval_loss": 5.052774332463741, "generalization_gap": 0.8912238702178001, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.161550462245941, "train_loss_last": 4.347846984863281, "val_eval_loss": 5.052774332463741}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.94828081130981, "eval_loss": 4.7864382192492485, "generalization_gap": 0.689209908246994, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.0972283110022545, "train_loss_last": 4.249028205871582, "val_eval_loss": 4.7864382192492485}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.9284291267395, "eval_loss": 4.558441236615181, "generalization_gap": 0.4488407149910927, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.109600521624088, "train_loss_last": 4.3183135986328125, "val_eval_loss": 4.558441236615181}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1756501197815, "eval_loss": 4.401971310377121, "generalization_gap": 0.32543984055519104, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.07653146982193, "train_loss_last": 4.001583576202393, "val_eval_loss": 4.401971310377121}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.56775212287903, "eval_loss": 5.48211994022131, "generalization_gap": 0.911006785929203, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.571113154292107, "train_loss_last": 4.735123634338379, "val_eval_loss": 5.48211994022131}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.47346210479736, "eval_loss": 5.078636907041073, "generalization_gap": 0.8553216382861137, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.223315268754959, "train_loss_last": 4.428989410400391, "val_eval_loss": 5.078636907041073}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.37687611579895, "eval_loss": 4.770952560007572, "generalization_gap": 0.6954368501901627, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.0755157098174095, "train_loss_last": 4.148219108581543, "val_eval_loss": 4.770952560007572}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.01151704788208, "eval_loss": 4.559795759618282, "generalization_gap": 0.5070498064160347, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.052745953202248, "train_loss_last": 4.133602142333984, "val_eval_loss": 4.559795759618282}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0887017250061, "eval_loss": 4.402896843850613, "generalization_gap": 0.3256060555577278, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.077290788292885, "train_loss_last": 4.316803932189941, "val_eval_loss": 4.402896843850613}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.2399332523346, "eval_loss": 5.4856060445308685, "generalization_gap": 0.9066294282674789, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.57897661626339, "train_loss_last": 4.885035514831543, "val_eval_loss": 5.4856060445308685}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.3847131729126, "eval_loss": 5.0676345229148865, "generalization_gap": 0.8415863737463951, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.226048149168491, "train_loss_last": 4.507782459259033, "val_eval_loss": 5.0676345229148865}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1736650466919, "eval_loss": 4.7791073098778725, "generalization_gap": 0.7003955617547035, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.078711748123169, "train_loss_last": 4.1192522048950195, "val_eval_loss": 4.7791073098778725}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0590569972992, "eval_loss": 4.563728243112564, "generalization_gap": 0.47459470480680466, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.089133538305759, "train_loss_last": 4.137112140655518, "val_eval_loss": 4.563728243112564}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.01433420181274, "eval_loss": 4.381064593791962, "generalization_gap": 0.31129128485918045, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.069773308932781, "train_loss_last": 3.990117311477661, "val_eval_loss": 4.381064593791962}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.29387283325195, "eval_loss": 5.509035885334015, "generalization_gap": 0.8720249384641647, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.63701094686985, "train_loss_last": 4.927996635437012, "val_eval_loss": 5.509035885334015}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.22580695152283, "eval_loss": 5.07570381462574, "generalization_gap": 0.8376745954155922, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.238029219210148, "train_loss_last": 4.416054725646973, "val_eval_loss": 5.07570381462574}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1633379459381, "eval_loss": 4.792380161583424, "generalization_gap": 0.7424318492412567, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.049948312342167, "train_loss_last": 4.2396697998046875, "val_eval_loss": 4.792380161583424}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0420618057251, "eval_loss": 4.536897249519825, "generalization_gap": 0.47198397666215897, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.064913272857666, "train_loss_last": 4.11806583404541, "val_eval_loss": 4.536897249519825}
-{"condition": "prevlocal_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.83358788490295, "eval_loss": 4.402371659874916, "generalization_gap": 0.3178385868668556, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.0845330730080605, "train_loss_last": 4.270941734313965, "val_eval_loss": 4.402371659874916}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 145.00203609466553, "eval_loss": 5.500026352703571, "generalization_gap": 0.8845655247569084, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.615460827946663, "train_loss_last": 4.844176292419434, "val_eval_loss": 5.500026352703571}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 145.0216257572174, "eval_loss": 5.0825527757406235, "generalization_gap": 0.8991758674383163, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.183376908302307, "train_loss_last": 4.244839668273926, "val_eval_loss": 5.0825527757406235}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 148.04349493980408, "eval_loss": 4.776466831564903, "generalization_gap": 0.664736419916153, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.11173041164875, "train_loss_last": 4.434404373168945, "val_eval_loss": 4.776466831564903}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 154.4656720161438, "eval_loss": 4.57609198987484, "generalization_gap": 0.491582490503788, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.084509499371052, "train_loss_last": 4.123593330383301, "val_eval_loss": 4.57609198987484}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 156.33115100860596, "eval_loss": 4.402347795665264, "generalization_gap": 0.3080834597349167, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.094264335930347, "train_loss_last": 4.194511413574219, "val_eval_loss": 4.402347795665264}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 157.64197206497192, "eval_loss": 5.496512919664383, "generalization_gap": 0.8909523785114288, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.605560541152954, "train_loss_last": 4.836062908172607, "val_eval_loss": 5.496512919664383}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.58259201049805, "eval_loss": 5.052774332463741, "generalization_gap": 0.8912238702178001, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.161550462245941, "train_loss_last": 4.347846984863281, "val_eval_loss": 5.052774332463741}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.94828081130981, "eval_loss": 4.7864382192492485, "generalization_gap": 0.689209908246994, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.0972283110022545, "train_loss_last": 4.249028205871582, "val_eval_loss": 4.7864382192492485}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.9284291267395, "eval_loss": 4.558441236615181, "generalization_gap": 0.4488407149910927, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.109600521624088, "train_loss_last": 4.3183135986328125, "val_eval_loss": 4.558441236615181}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1756501197815, "eval_loss": 4.401971310377121, "generalization_gap": 0.32543984055519104, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 2, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.07653146982193, "train_loss_last": 4.001583576202393, "val_eval_loss": 4.401971310377121}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.56775212287903, "eval_loss": 5.48211994022131, "generalization_gap": 0.911006785929203, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.571113154292107, "train_loss_last": 4.735123634338379, "val_eval_loss": 5.48211994022131}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.47346210479736, "eval_loss": 5.078636907041073, "generalization_gap": 0.8553216382861137, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.223315268754959, "train_loss_last": 4.428989410400391, "val_eval_loss": 5.078636907041073}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.37687611579895, "eval_loss": 4.770952560007572, "generalization_gap": 0.6954368501901627, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.0755157098174095, "train_loss_last": 4.148219108581543, "val_eval_loss": 4.770952560007572}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.01151704788208, "eval_loss": 4.559795759618282, "generalization_gap": 0.5070498064160347, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.052745953202248, "train_loss_last": 4.133602142333984, "val_eval_loss": 4.559795759618282}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0887017250061, "eval_loss": 4.402896843850613, "generalization_gap": 0.3256060555577278, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 3, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.077290788292885, "train_loss_last": 4.316803932189941, "val_eval_loss": 4.402896843850613}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.2399332523346, "eval_loss": 5.4856060445308685, "generalization_gap": 0.9066294282674789, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.57897661626339, "train_loss_last": 4.885035514831543, "val_eval_loss": 5.4856060445308685}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.3847131729126, "eval_loss": 5.0676345229148865, "generalization_gap": 0.8415863737463951, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.226048149168491, "train_loss_last": 4.507782459259033, "val_eval_loss": 5.0676345229148865}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1736650466919, "eval_loss": 4.7791073098778725, "generalization_gap": 0.7003955617547035, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.078711748123169, "train_loss_last": 4.1192522048950195, "val_eval_loss": 4.7791073098778725}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0590569972992, "eval_loss": 4.563728243112564, "generalization_gap": 0.47459470480680466, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.089133538305759, "train_loss_last": 4.137112140655518, "val_eval_loss": 4.563728243112564}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.01433420181274, "eval_loss": 4.381064593791962, "generalization_gap": 0.31129128485918045, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 4, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.069773308932781, "train_loss_last": 3.990117311477661, "val_eval_loss": 4.381064593791962}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.385, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.29387283325195, "eval_loss": 5.509035885334015, "generalization_gap": 0.8720249384641647, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.63701094686985, "train_loss_last": 4.927996635437012, "val_eval_loss": 5.509035885334015}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.319, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.22580695152283, "eval_loss": 5.07570381462574, "generalization_gap": 0.8376745954155922, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.238029219210148, "train_loss_last": 4.416054725646973, "val_eval_loss": 5.07570381462574}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.227, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.1633379459381, "eval_loss": 4.792380161583424, "generalization_gap": 0.7424318492412567, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.049948312342167, "train_loss_last": 4.2396697998046875, "val_eval_loss": 4.792380161583424}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.139, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.0420618057251, "eval_loss": 4.536897249519825, "generalization_gap": 0.47198397666215897, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 3, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_eval_loss": 4.064913272857666, "train_loss_last": 4.11806583404541, "val_eval_loss": 4.536897249519825}
+{"condition": "openwebtext10k_interaction", "condition_kind": "anchor_decay", "dropout_active_final": 0.066, "dropout_final": 0.066, "dropout_initial": 0.385, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 158.83358788490295, "eval_loss": 4.402371659874916, "generalization_gap": 0.3178385868668556, "model_config": {"block_size": 128, "dropout": 0.385, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 5, "stage": 4, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_eval_loss": 4.0845330730080605, "train_loss_last": 4.270941734313965, "val_eval_loss": 4.402371659874916}
 {"condition": "hold_30_then_decay", "condition_kind": "anchor_decay", "dropout_active_final": 0.3, "dropout_final": 0.02, "dropout_initial": 0.3, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.01670002937317, "eval_loss": 5.46150516718626, "generalization_gap": 0.9761984124779701, "model_config": {"block_size": 128, "dropout": 0.3, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 0, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_eval_loss": 4.48530675470829, "train_loss_last": 4.836114883422852, "val_eval_loss": 5.46150516718626}
 {"condition": "hold_30_then_decay", "condition_kind": "anchor_decay", "dropout_active_final": 0.3, "dropout_final": 0.02, "dropout_initial": 0.3, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.13048791885376, "eval_loss": 5.0823986530303955, "generalization_gap": 0.9970467239618301, "model_config": {"block_size": 128, "dropout": 0.3, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 1, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_eval_loss": 4.085351929068565, "train_loss_last": 4.226001739501953, "val_eval_loss": 5.0823986530303955}
 {"condition": "hold_30_then_decay", "condition_kind": "anchor_decay", "dropout_active_final": 0.2, "dropout_final": 0.02, "dropout_initial": 0.3, "dropout_schedule": "log_prefix_anchor", "elapsed_sec": 159.02239680290222, "eval_loss": 4.7529231160879135, "generalization_gap": 0.737479031085968, "model_config": {"block_size": 128, "dropout": 0.3, "n_embd": 384, "n_head": 8, "n_layer": 16, "vocab_size": 4096}, "model_name": "L16_H8_D384", "n_embd": 384, "n_head": 8, "n_layer": 16, "parameters": 31457280, "run_mode": "locked_stream", "seed": 1, "stage": 2, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_eval_loss": 4.0154440850019455, "train_loss_last": 4.443882942199707, "val_eval_loss": 4.7529231160879135}

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/summary.csv

@@ -2,7 +2,7 @@ run_mode,condition,condition_kind,stage,token_limit,model_name,n_layer,n_head,n_
 locked_stream,fitted_l16_static_law,anchor_decay,0,250000,L16_H8_D384,16,8,384,31457280,0.6,0.02,log_prefix_anchor,5,5.164006796479225,0.02748612153330559,5.7842145070433615,0.009632183754286684,0.6202077105641365,0.018181362630120823
 locked_stream,hold_30_then_decay,anchor_decay,0,250000,L16_H8_D384,16,8,384,31457280,0.3,0.02,log_prefix_anchor,5,4.442901518940926,0.027340510763309508,5.4483301296830176,0.013828501308583057,1.0054286107420922,0.02219730946529904
 locked_stream,mild_30_to_08,anchor_decay,0,250000,L16_H8_D384,16,8,384,31457280,0.3,0.08,log_prefix_anchor,5,4.442901518940926,0.027340586099289153,5.448330116271973,0.013828516502701142,1.005428597331047,0.022197359989343385
-locked_stream,prevlocal_interaction,anchor_decay,0,250000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.6016244173049925,0.026939774812057612,5.4946602284908295,0.01093302726132647,0.8930358111858367,0.016010040404479016
+locked_stream,openwebtext10k_interaction,anchor_decay,0,250000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.6016244173049925,0.026939774812057612,5.4946602284908295,0.01093302726132647,0.8930358111858367,0.016010040404479016
 locked_stream,static_dropout_0,static,0,250000,L16_H8_D384,16,8,384,31457280,0.0,0.0,constant,5,3.4442542552948,0.022358399496724347,5.8329681470990185,0.019809207037273006,2.388713891804218,0.038334133145443657
 locked_stream,static_dropout_0.02,static,0,250000,L16_H8_D384,16,8,384,31457280,0.02,0.02,constant,5,3.537110958993435,0.008037117123073168,5.742638063430786,0.024161263410536992,2.2055271044373512,0.030737843551395496
 locked_stream,static_dropout_0.14,static,0,250000,L16_H8_D384,16,8,384,31457280,0.14,0.14,constant,5,4.029827673733235,0.018556819977249093,5.477323499321938,0.02236835486589015,1.4474958255887032,0.03092474074054602
@@ -10,7 +10,7 @@ locked_stream,static_dropout_0.3,static,0,250000,L16_H8_D384,16,8,384,31457280,0
 locked_stream,fitted_l16_static_law,anchor_decay,1,500000,L16_H8_D384,16,8,384,31457280,0.6,0.02,log_prefix_anchor,5,4.463223123550415,0.029267257511679485,5.150681225955486,0.010164023432481408,0.6874581024050712,0.024496105147219012
 locked_stream,hold_30_then_decay,anchor_decay,1,500000,L16_H8_D384,16,8,384,31457280,0.3,0.02,log_prefix_anchor,5,4.1383186161518095,0.03875357135925004,5.066737350821495,0.017273545737457947,0.9284187346696854,0.04002925354224623
 locked_stream,mild_30_to_08,anchor_decay,1,500000,L16_H8_D384,16,8,384,31457280,0.3,0.08,log_prefix_anchor,5,4.034893324971199,0.04033083916799125,5.058184179663658,0.015882720199114145,1.023290854692459,0.04098800520602419
-locked_stream,prevlocal_interaction,anchor_decay,1,500000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.20646400153637,0.03245807641301778,5.071460470557213,0.01179360076463939,0.8649964690208435,0.028479060454710485
+locked_stream,openwebtext10k_interaction,anchor_decay,1,500000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.20646400153637,0.03245807641301778,5.071460470557213,0.01179360076463939,0.8649964690208435,0.028479060454710485
 locked_stream,static_dropout_0,static,1,500000,L16_H8_D384,16,8,384,31457280,0.0,0.0,constant,5,2.958326259255409,0.044781060309162554,5.717529235780239,0.05024223752386389,2.75920297652483,0.07102439530887096
 locked_stream,static_dropout_0.02,static,1,500000,L16_H8_D384,16,8,384,31457280,0.02,0.02,constant,5,3.124619247019291,0.031814549489392455,5.575391733646393,0.024791398740622035,2.450772486627102,0.030503049251572257
 locked_stream,static_dropout_0.14,static,1,500000,L16_H8_D384,16,8,384,31457280,0.14,0.14,constant,5,3.714307613670826,0.03238913748160129,5.149166536331177,0.007010026540791338,1.4348589226603508,0.031243440426199517
@@ -18,7 +18,7 @@ locked_stream,static_dropout_0.3,static,1,500000,L16_H8_D384,16,8,384,31457280,0
 locked_stream,fitted_l16_static_law,anchor_decay,2,1000000,L16_H8_D384,16,8,384,31457280,0.6,0.02,log_prefix_anchor,5,4.263189716637134,0.02333674196202296,4.832601730525494,0.010169544124120607,0.569412013888359,0.023004537548591726
 locked_stream,hold_30_then_decay,anchor_decay,2,1000000,L16_H8_D384,16,8,384,31457280,0.3,0.02,log_prefix_anchor,5,4.037793649733066,0.02368477035230831,4.775730343163014,0.014352387307903692,0.7379366934299469,0.01882967372675974
 locked_stream,mild_30_to_08,anchor_decay,2,1000000,L16_H8_D384,16,8,384,31457280,0.3,0.08,log_prefix_anchor,5,3.9886452093720437,0.02349137402419598,4.777442049980164,0.013845858727658497,0.7887968406081199,0.018652082916074838
-locked_stream,prevlocal_interaction,anchor_decay,2,1000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.08262689858675,0.023420093535722695,4.781069016456604,0.008428247627355752,0.698442117869854,0.028148054160246055
+locked_stream,openwebtext10k_interaction,anchor_decay,2,1000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.08262689858675,0.023420093535722695,4.781069016456604,0.008428247627355752,0.698442117869854,0.028148054160246055
 locked_stream,static_dropout_0,static,2,1000000,L16_H8_D384,16,8,384,31457280,0.0,0.0,constant,5,3.3260142356157303,0.03607156293344983,5.26366505920887,0.027353946222948587,1.9376508235931396,0.03553067411055354
 locked_stream,static_dropout_0.02,static,2,1000000,L16_H8_D384,16,8,384,31457280,0.02,0.02,constant,5,3.4615398421883583,0.03992270092195685,5.14697041362524,0.022233878343551068,1.685430571436882,0.04092951267469098
 locked_stream,static_dropout_0.14,static,2,1000000,L16_H8_D384,16,8,384,31457280,0.14,0.14,constant,5,3.8711691960692405,0.02974306105040781,4.849037018418312,0.020208736415348236,0.9778678223490715,0.023799818088071894
@@ -26,7 +26,7 @@ locked_stream,static_dropout_0.3,static,2,1000000,L16_H8_D384,16,8,384,31457280,
 locked_stream,fitted_l16_static_law,anchor_decay,3,2000000,L16_H8_D384,16,8,384,31457280,0.6,0.02,log_prefix_anchor,5,4.14712455868721,0.01706029159496315,4.58056578040123,0.01532149630405117,0.4334412217140198,0.019914111395845077
 locked_stream,hold_30_then_decay,anchor_decay,3,2000000,L16_H8_D384,16,8,384,31457280,0.3,0.02,log_prefix_anchor,5,4.044496415555477,0.019708741233353012,4.559869511425495,0.016051317749301037,0.515373095870018,0.020379012527272283
 locked_stream,mild_30_to_08,anchor_decay,3,2000000,L16_H8_D384,16,8,384,31457280,0.3,0.08,log_prefix_anchor,5,4.044088624417782,0.020441976517745996,4.563060106337071,0.015509498762185112,0.5189714819192887,0.022529376522631556
-locked_stream,prevlocal_interaction,anchor_decay,3,2000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.080180557072163,0.022080406390158354,4.558990895748138,0.014177173687439483,0.4788103386759758,0.021926835907345392
+locked_stream,openwebtext10k_interaction,anchor_decay,3,2000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.080180557072163,0.022080406390158354,4.558990895748138,0.014177173687439483,0.4788103386759758,0.021926835907345392
 locked_stream,static_dropout_0,static,3,2000000,L16_H8_D384,16,8,384,31457280,0.0,0.0,constant,5,3.778580814599991,0.03536285448761605,4.847234210371971,0.0170992476167825,1.0686533957719804,0.025604091638377884
 locked_stream,static_dropout_0.02,static,3,2000000,L16_H8_D384,16,8,384,31457280,0.02,0.02,constant,5,3.840523959696293,0.03097454466954304,4.784735175967216,0.019582585992709827,0.9442112162709236,0.02147121638277758
 locked_stream,static_dropout_0.14,static,3,2000000,L16_H8_D384,16,8,384,31457280,0.14,0.14,constant,5,4.039909638464451,0.025550506633378975,4.6047517821192745,0.013619996903704912,0.5648421436548233,0.015970945478988943
@@ -34,7 +34,7 @@ locked_stream,static_dropout_0.3,static,3,2000000,L16_H8_D384,16,8,384,31457280,
 locked_stream,fitted_l16_static_law,anchor_decay,4,4000000,L16_H8_D384,16,8,384,31457280,0.6,0.02,log_prefix_anchor,5,4.098657152056694,0.01111204513074185,4.412404176592827,0.00843791675235308,0.3137470245361328,0.007204760471400837
 locked_stream,hold_30_then_decay,anchor_decay,4,4000000,L16_H8_D384,16,8,384,31457280,0.3,0.02,log_prefix_anchor,5,4.0487526342272755,0.007824452256379268,4.405232906341553,0.011151070705538514,0.3564802721142769,0.01297330703929578
 locked_stream,mild_30_to_08,anchor_decay,4,4000000,L16_H8_D384,16,8,384,31457280,0.3,0.08,log_prefix_anchor,5,4.07358001768589,0.0063536190340169095,4.40728645324707,0.008502541215009067,0.3337064355611801,0.010359634321755684
-locked_stream,prevlocal_interaction,anchor_decay,4,4000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.080478595197201,0.009311692964638253,4.3981304407119755,0.009545784836147743,0.3176518455147743,0.007999498965173152
+locked_stream,openwebtext10k_interaction,anchor_decay,4,4000000,L16_H8_D384,16,8,384,31457280,0.385,0.066,log_prefix_anchor,5,4.080478595197201,0.009311692964638253,4.3981304407119755,0.009545784836147743,0.3176518455147743,0.007999498965173152
 locked_stream,static_dropout_0,static,4,4000000,L16_H8_D384,16,8,384,31457280,0.0,0.0,constant,5,4.041403333842754,0.017193152802814336,4.594272664189338,0.021638340853154137,0.5528693303465844,0.029132548047629703
 locked_stream,static_dropout_0.02,static,4,4000000,L16_H8_D384,16,8,384,31457280,0.02,0.02,constant,5,4.052870315313339,0.02163703576438587,4.535757505893708,0.00908401354385357,0.48288719058036805,0.020126181497736668
 locked_stream,static_dropout_0.14,static,4,4000000,L16_H8_D384,16,8,384,31457280,0.14,0.14,constant,5,4.116507206857205,0.014037194709348206,4.44545366615057,0.012017216742245517,0.32894645929336547,0.01603071874172604

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/summary.json

@@ -67,7 +67,7 @@
   },
   {
     "run_mode": "locked_stream",
-    "condition": "prevlocal_interaction",
+    "condition": "openwebtext10k_interaction",
     "condition_kind": "anchor_decay",
     "stage": 0,
     "token_limit": 250000,
@@ -243,7 +243,7 @@
   },
   {
     "run_mode": "locked_stream",
-    "condition": "prevlocal_interaction",
+    "condition": "openwebtext10k_interaction",
     "condition_kind": "anchor_decay",
     "stage": 1,
     "token_limit": 500000,
@@ -419,7 +419,7 @@
   },
   {
     "run_mode": "locked_stream",
-    "condition": "prevlocal_interaction",
+    "condition": "openwebtext10k_interaction",
     "condition_kind": "anchor_decay",
     "stage": 2,
     "token_limit": 1000000,
@@ -595,7 +595,7 @@
   },
   {
     "run_mode": "locked_stream",
-    "condition": "prevlocal_interaction",
+    "condition": "openwebtext10k_interaction",
     "condition_kind": "anchor_decay",
     "stage": 3,
     "token_limit": 2000000,
@@ -771,7 +771,7 @@
   },
   {
     "run_mode": "locked_stream",
-    "condition": "prevlocal_interaction",
+    "condition": "openwebtext10k_interaction",
     "condition_kind": "anchor_decay",
     "stage": 4,
     "token_limit": 4000000,

runs/{previous_local_updated_formula_clean_l16 → openwebtext10k_l16_updated_formula_clean_5seed}/locked_stream/20260530-174525/trace.jsonl

@@ -1,103 +1,103 @@
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.171935558319092}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.48825740814209}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 4.841618061065674}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.844176292419434}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.8820390701293945}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.497588157653809}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.518710136413574}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.244839668273926}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.528886795043945}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.406923770904541}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.215362548828125}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.434404373168945}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.3406572341918945}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.156265735626221}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.173320770263672}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.123593330383301}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.2380781173706055}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.078634262084961}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.236572265625}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.194511413574219}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.254297256469727}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.503683567047119}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.088714122772217}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.836062908172607}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.710488319396973}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.585000991821289}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.286666393280029}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.347846984863281}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.413064002990723}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.370894432067871}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.284385681152344}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.249028205871582}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.31729793548584}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.12711238861084}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.441766738891602}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.3183135986328125}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.346931457519531}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.198246479034424}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.135946273803711}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.001583576202393}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.144522666931152}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.652010917663574}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 4.912023544311523}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.735123634338379}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.92975378036499}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.763935089111328}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.548640251159668}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.428989410400391}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.43540096282959}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.226118087768555}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.112758636474609}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.148219108581543}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.413056373596191}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.175434112548828}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.2766265869140625}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.133602142333984}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.40939998626709}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.337164878845215}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.1670074462890625}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.316803932189941}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.117185592651367}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.526948928833008}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.118289947509766}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.885035514831543}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.551980018615723}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.621177673339844}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.473027229309082}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.507782459259033}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.615119934082031}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.372061729431152}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.355410099029541}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.1192522048950195}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.4725799560546875}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.226810455322266}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.25181770324707}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.137112140655518}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.0571441650390625}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.087485313415527}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.146313190460205}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 3.990117311477661}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.368095397949219}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.487208366394043}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.186356544494629}
-{"condition": "prevlocal_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.927996635437012}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.755383014678955}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.4085564613342285}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.513108253479004}
-{"condition": "prevlocal_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.416054725646973}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.688089370727539}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.242029190063477}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.343423843383789}
-{"condition": "prevlocal_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.2396697998046875}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.3881611824035645}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.271755218505859}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.025024890899658}
-{"condition": "prevlocal_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.11806583404541}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 3.955113649368286}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.345088005065918}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.051096439361572}
-{"condition": "prevlocal_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.270941734313965}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.171935558319092}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.48825740814209}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 4.841618061065674}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.844176292419434}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.8820390701293945}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.497588157653809}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.518710136413574}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.244839668273926}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.528886795043945}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.406923770904541}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.215362548828125}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.434404373168945}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.3406572341918945}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.156265735626221}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.173320770263672}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.123593330383301}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.2380781173706055}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.078634262084961}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.236572265625}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.194511413574219}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.254297256469727}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.503683567047119}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.088714122772217}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.836062908172607}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.710488319396973}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.585000991821289}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.286666393280029}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.347846984863281}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.413064002990723}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.370894432067871}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.284385681152344}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.249028205871582}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.31729793548584}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.12711238861084}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.441766738891602}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.3183135986328125}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.346931457519531}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.198246479034424}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.135946273803711}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 2, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.001583576202393}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.144522666931152}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.652010917663574}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 4.912023544311523}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.735123634338379}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.92975378036499}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.763935089111328}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.548640251159668}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.428989410400391}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.43540096282959}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.226118087768555}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.112758636474609}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.148219108581543}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.413056373596191}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.175434112548828}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.2766265869140625}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.133602142333984}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.40939998626709}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.337164878845215}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.1670074462890625}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 3, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.316803932189941}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.117185592651367}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.526948928833008}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.118289947509766}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.885035514831543}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.551980018615723}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.621177673339844}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.473027229309082}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.507782459259033}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.615119934082031}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.372061729431152}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.355410099029541}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.1192522048950195}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.4725799560546875}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.226810455322266}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.25181770324707}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.137112140655518}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 4.0571441650390625}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.087485313415527}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.146313190460205}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 4, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 3.990117311477661}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.368095397949219}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.487208366394043}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 5.186356544494629}
+{"condition": "openwebtext10k_interaction", "dropout": 0.385, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 0, "step": 1000, "steps": 1000, "token_limit": 250000, "tokens_seen": 2048000, "train_batch_loss": 4.927996635437012}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 250, "steps": 1000, "token_limit": 500000, "tokens_seen": 2560000, "train_batch_loss": 4.755383014678955}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 500, "steps": 1000, "token_limit": 500000, "tokens_seen": 3072000, "train_batch_loss": 4.4085564613342285}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 750, "steps": 1000, "token_limit": 500000, "tokens_seen": 3584000, "train_batch_loss": 4.513108253479004}
+{"condition": "openwebtext10k_interaction", "dropout": 0.319, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 1, "step": 1000, "steps": 1000, "token_limit": 500000, "tokens_seen": 4096000, "train_batch_loss": 4.416054725646973}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 250, "steps": 1000, "token_limit": 1000000, "tokens_seen": 4608000, "train_batch_loss": 4.688089370727539}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 500, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5120000, "train_batch_loss": 4.242029190063477}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 750, "steps": 1000, "token_limit": 1000000, "tokens_seen": 5632000, "train_batch_loss": 4.343423843383789}
+{"condition": "openwebtext10k_interaction", "dropout": 0.227, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 2, "step": 1000, "steps": 1000, "token_limit": 1000000, "tokens_seen": 6144000, "train_batch_loss": 4.2396697998046875}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 250, "steps": 1000, "token_limit": 2000000, "tokens_seen": 6656000, "train_batch_loss": 4.3881611824035645}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 500, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7168000, "train_batch_loss": 4.271755218505859}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 750, "steps": 1000, "token_limit": 2000000, "tokens_seen": 7680000, "train_batch_loss": 4.025024890899658}
+{"condition": "openwebtext10k_interaction", "dropout": 0.139, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 3, "step": 1000, "steps": 1000, "token_limit": 2000000, "tokens_seen": 8192000, "train_batch_loss": 4.11806583404541}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 250, "steps": 1000, "token_limit": 4000000, "tokens_seen": 8704000, "train_batch_loss": 3.955113649368286}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 500, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9216000, "train_batch_loss": 4.345088005065918}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 750, "steps": 1000, "token_limit": 4000000, "tokens_seen": 9728000, "train_batch_loss": 4.051096439361572}
+{"condition": "openwebtext10k_interaction", "dropout": 0.066, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 5, "stage": 4, "step": 1000, "steps": 1000, "token_limit": 4000000, "tokens_seen": 10240000, "train_batch_loss": 4.270941734313965}
 {"condition": "hold_30_then_decay", "dropout": 0.3, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 250, "steps": 1000, "token_limit": 250000, "tokens_seen": 512000, "train_batch_loss": 6.104031562805176}
 {"condition": "hold_30_then_decay", "dropout": 0.3, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 500, "steps": 1000, "token_limit": 250000, "tokens_seen": 1024000, "train_batch_loss": 5.276653289794922}
 {"condition": "hold_30_then_decay", "dropout": 0.3, "event": "train_step", "model_name": "L16_H8_D384", "run_mode": "locked_stream", "seed": 1, "stage": 0, "step": 750, "steps": 1000, "token_limit": 250000, "tokens_seen": 1536000, "train_batch_loss": 4.9929280281066895}

runs/{previous_local_streaming_report → openwebtext10k_streaming_report}/l16_updated_formula_clean_5seed/condition_summary.csv

@@ -1,5 +1,5 @@
 condition,kind,n,mean_trajectory_val,std_trajectory_val,mean_final_val,std_final_val,mean_final_gap,std_final_gap,dropout_path
-prevlocal_interaction,anchor_decay,5,4.860862210392952,0.0046364279557658235,4.3981304407119755,0.009545784836147743,0.3176518455147743,0.007999498965173152,0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07
+openwebtext10k_interaction,anchor_decay,5,4.860862210392952,0.0046364279557658235,4.3981304407119755,0.009545784836147743,0.3176518455147743,0.007999498965173152,0.39 -> 0.32 -> 0.23 -> 0.14 -> 0.07
 hold_30_then_decay,anchor_decay,5,4.851180048286915,0.0016753687570399134,4.405232906341553,0.011151070705538514,0.3564802721142769,0.01297330703929578,0.30 -> 0.30 -> 0.20 -> 0.10 -> 0.02
 mild_30_to_08,anchor_decay,5,4.850860581099987,0.0014618995680224028,4.40728645324707,0.008502541215009067,0.3337064355611801,0.010359634321755684,0.30 -> 0.24 -> 0.18 -> 0.12 -> 0.08
 fitted_l16_static_law,anchor_decay,5,4.952093484103679,0.0038574646544463683,4.412404176592827,0.00843791675235308,0.3137470245361328,0.007204760471400837,0.60 -> 0.40 -> 0.30 -> 0.14 -> 0.02

runs/{previous_local_streaming_report → openwebtext10k_streaming_report}/l16_updated_formula_clean_5seed/paired_final_deltas.csv

@@ -1,5 +1,5 @@
 seed,condition,final_val,best_static_condition,best_static_final_val,delta_vs_best_static
-1,prevlocal_interaction,4.402347795665264,static_dropout_0.14,4.4417688846588135,-0.03942108899354935
+1,openwebtext10k_interaction,4.402347795665264,static_dropout_0.14,4.4417688846588135,-0.03942108899354935
 1,hold_30_then_decay,4.393906190991402,static_dropout_0.14,4.4417688846588135,-0.047862693667411804
 1,mild_30_to_08,4.399485997855663,static_dropout_0.14,4.4417688846588135,-0.04228288680315018
 1,fitted_l16_static_law,4.420692957937717,static_dropout_0.14,4.4417688846588135,-0.02107592672109604
@@ -7,7 +7,7 @@ seed,condition,final_val,best_static_condition,best_static_final_val,delta_vs_be
 1,static_dropout_0.3,4.460195399820805,static_dropout_0.14,4.4417688846588135,0.01842651516199112
 1,static_dropout_0.02,4.5401855930686,static_dropout_0.14,4.4417688846588135,0.09841670840978622
 1,static_dropout_0,4.570374272763729,static_dropout_0.14,4.4417688846588135,0.12860538810491562
-2,prevlocal_interaction,4.401971310377121,static_dropout_0.14,4.460222490131855,-0.05825117975473404
+2,openwebtext10k_interaction,4.401971310377121,static_dropout_0.14,4.460222490131855,-0.05825117975473404
 2,hold_30_then_decay,4.406779877841473,static_dropout_0.14,4.460222490131855,-0.053442612290382385
 2,mild_30_to_08,4.4080275148153305,static_dropout_0.14,4.460222490131855,-0.052194975316524506
 2,fitted_l16_static_law,4.41358345746994,static_dropout_0.14,4.460222490131855,-0.046639032661914825
@@ -15,7 +15,7 @@ seed,condition,final_val,best_static_condition,best_static_final_val,delta_vs_be
 2,static_dropout_0.3,4.4719239845871925,static_dropout_0.14,4.460222490131855,0.011701494455337524
 2,static_dropout_0.02,4.546629846096039,static_dropout_0.14,4.460222490131855,0.08640735596418381
 2,static_dropout_0,4.609437867999077,static_dropout_0.14,4.460222490131855,0.14921537786722183
-3,prevlocal_interaction,4.402896843850613,static_dropout_0.14,4.43564984947443,-0.032753005623817444
+3,openwebtext10k_interaction,4.402896843850613,static_dropout_0.14,4.43564984947443,-0.032753005623817444
 3,hold_30_then_decay,4.417374566197395,static_dropout_0.14,4.43564984947443,-0.01827528327703476
 3,mild_30_to_08,4.415062002837658,static_dropout_0.14,4.43564984947443,-0.020587846636772156
 3,fitted_l16_static_law,4.413399815559387,static_dropout_0.14,4.43564984947443,-0.022250033915042877
@@ -23,7 +23,7 @@ seed,condition,final_val,best_static_condition,best_static_final_val,delta_vs_be
 3,static_dropout_0.3,4.475773207843304,static_dropout_0.14,4.43564984947443,0.040123358368873596
 3,static_dropout_0.02,4.534482300281525,static_dropout_0.14,4.43564984947443,0.09883245080709457
 3,static_dropout_0,4.592755533754826,static_dropout_0.14,4.43564984947443,0.1571056842803955
-4,prevlocal_interaction,4.381064593791962,static_dropout_0.14,4.433655060827732,-0.052590467035770416
+4,openwebtext10k_interaction,4.381064593791962,static_dropout_0.14,4.433655060827732,-0.052590467035770416
 4,hold_30_then_decay,4.3936478942632675,static_dropout_0.14,4.433655060827732,-0.04000716656446457
 4,mild_30_to_08,4.397788874804974,static_dropout_0.14,4.433655060827732,-0.035866186022758484
 4,fitted_l16_static_law,4.398257076740265,static_dropout_0.14,4.433655060827732,-0.035397984087467194
@@ -31,7 +31,7 @@ seed,condition,final_val,best_static_condition,best_static_final_val,delta_vs_be
 4,static_dropout_0.3,4.445499815046787,static_dropout_0.14,4.433655060827732,0.011844754219055176
 4,static_dropout_0.02,4.52195218205452,static_dropout_0.14,4.433655060827732,0.08829712122678757
 4,static_dropout_0,4.576848782598972,static_dropout_0.14,4.433655060827732,0.14319372177124023
-5,prevlocal_interaction,4.402371659874916,static_dropout_0.14,4.455972045660019,-0.053600385785102844
+5,openwebtext10k_interaction,4.402371659874916,static_dropout_0.14,4.455972045660019,-0.053600385785102844
 5,hold_30_then_decay,4.4144560024142265,static_dropout_0.14,4.455972045660019,-0.04151604324579239
 5,mild_30_to_08,4.416067875921726,static_dropout_0.14,4.455972045660019,-0.039904169738292694
 5,fitted_l16_static_law,4.4160875752568245,static_dropout_0.14,4.455972045660019,-0.03988447040319443

runs/{previous_local_streaming_report → openwebtext10k_streaming_report}/l16_updated_formula_clean_5seed/stage_summary.csv

@@ -1,9 +1,9 @@
 condition,stage,token_limit,dropout,n,mean_val,std_val,mean_train,std_train,mean_gap,std_gap
-prevlocal_interaction,0,250000,0.385,5,5.4946602284908295,0.01093302726132647,4.6016244173049925,0.026939774812057612,0.8930358111858367,0.016010040404479016
-prevlocal_interaction,1,500000,0.319,5,5.071460470557213,0.01179360076463939,4.20646400153637,0.03245807641301778,0.8649964690208435,0.028479060454710485
-prevlocal_interaction,2,1000000,0.227,5,4.781069016456604,0.008428247627355752,4.08262689858675,0.023420093535722695,0.698442117869854,0.028148054160246055
-prevlocal_interaction,3,2000000,0.139,5,4.558990895748138,0.014177173687439483,4.080180557072163,0.022080406390158354,0.4788103386759758,0.021926835907345392
-prevlocal_interaction,4,4000000,0.066,5,4.3981304407119755,0.009545784836147743,4.080478595197201,0.009311692964638253,0.3176518455147743,0.007999498965173152
+openwebtext10k_interaction,0,250000,0.385,5,5.4946602284908295,0.01093302726132647,4.6016244173049925,0.026939774812057612,0.8930358111858367,0.016010040404479016
+openwebtext10k_interaction,1,500000,0.319,5,5.071460470557213,0.01179360076463939,4.20646400153637,0.03245807641301778,0.8649964690208435,0.028479060454710485
+openwebtext10k_interaction,2,1000000,0.227,5,4.781069016456604,0.008428247627355752,4.08262689858675,0.023420093535722695,0.698442117869854,0.028148054160246055
+openwebtext10k_interaction,3,2000000,0.139,5,4.558990895748138,0.014177173687439483,4.080180557072163,0.022080406390158354,0.4788103386759758,0.021926835907345392
+openwebtext10k_interaction,4,4000000,0.066,5,4.3981304407119755,0.009545784836147743,4.080478595197201,0.009311692964638253,0.3176518455147743,0.007999498965173152
 hold_30_then_decay,0,250000,0.3,5,5.4483301296830176,0.013828501308583057,4.442901518940926,0.027340510763309508,1.0054286107420922,0.02219730946529904
 hold_30_then_decay,1,500000,0.3,5,5.066737350821495,0.017273545737457947,4.1383186161518095,0.03875357135925004,0.9284187346696854,0.04002925354224623
 hold_30_then_decay,2,1000000,0.2,5,4.775730343163014,0.014352387307903692,4.037793649733066,0.02368477035230831,0.7379366934299469,0.01882967372675974

scripts/summarize_cross_regime_backtest.py

@@ -31,10 +31,10 @@ REPORT_PATH = Path("docs/cross_regime_backtest_report.md")
 
 
 FIT_DIRS = {
-    "previous_local_main_base": ROOT / "previous_local_main_base",
-    "previous_local_main_interaction": ROOT / "previous_local_main_interaction",
-    "previous_local_plus_5m_base": ROOT / "previous_local_plus_5m_base",
-    "previous_local_plus_5m_interaction": ROOT / "previous_local_plus_5m_interaction",
+    "openwebtext10k_main_base": ROOT / "openwebtext10k_main_base",
+    "openwebtext10k_main_interaction": ROOT / "openwebtext10k_main_interaction",
+    "openwebtext10k_plus_5m_base": ROOT / "openwebtext10k_plus_5m_base",
+    "openwebtext10k_plus_5m_interaction": ROOT / "openwebtext10k_plus_5m_interaction",
     "pooled_previous_plus_corpus_probes_base": ROOT
     / "pooled_previous_plus_corpus_probes_base",
     "pooled_previous_plus_corpus_probes_interaction": ROOT
@@ -172,10 +172,10 @@ def write_transfer_csv(items: list[dict[str, float | str]]) -> None:
 
 def main() -> None:
     transfer_items = [
-        error_metrics("previous_local_plus_5m_base", "tinystories_all_base"),
-        error_metrics("tinystories_all_base", "previous_local_plus_5m_base"),
-        error_metrics("previous_local_plus_5m_interaction", "tinystories_all_interaction"),
-        error_metrics("tinystories_all_interaction", "previous_local_plus_5m_interaction"),
+        error_metrics("openwebtext10k_plus_5m_base", "tinystories_all_base"),
+        error_metrics("tinystories_all_base", "openwebtext10k_plus_5m_base"),
+        error_metrics("openwebtext10k_plus_5m_interaction", "tinystories_all_interaction"),
+        error_metrics("tinystories_all_interaction", "openwebtext10k_plus_5m_interaction"),
         error_metrics(
             "pooled_previous_plus_corpus_probes_interaction",
             "tinystories_all_interaction",
@@ -200,8 +200,8 @@ def main() -> None:
         "",
         "| Regime/source | Run directories | Role |",
         "|---|---|---|",
-        "| previous local main | `runs/screen_static/20260525-133008` | old/local static screen, 15 cells |",
-        "| previous local + 5M | previous local main + `runs/screen_static/20260525-122824` | previous local regime plus low-pressure 5M extension, 18 cells |",
+        "| OpenWebText10K main | `runs/screen_static/20260525-133008` | OpenWebText10K static screen, 15 cells |",
+        "| OpenWebText10K + 5M | OpenWebText10K main + `runs/screen_static/20260525-122824` | OpenWebText10K regime plus low-pressure 5M extension, 18 cells |",
         "| corpus probes | `runs/corpus_difficulty_pressure_{local,tinystories,wikitext103}` | diagnostic rows for corpus sensitivity |",
         "| current TinyStories | `runs/regime_calibration_tinystories_*` | current coefficient evidence, 16 cells |",
         "",
@@ -209,17 +209,17 @@ def main() -> None:
         "",
         "| Fit | Feature set | Cells | MAE | RMSE | Leave-model MAE | Leave-prefix MAE | Leave-source MAE | Coefficients |",
         "|---|---|---:|---:|---:|---:|---:|---:|---|",
-        metrics_row("previous_local_main_base", "previous local main"),
-        metrics_row("previous_local_main_interaction", "previous local main"),
-        metrics_row("previous_local_plus_5m_base", "previous local + 5M"),
-        metrics_row("previous_local_plus_5m_interaction", "previous local + 5M"),
+        metrics_row("openwebtext10k_main_base", "OpenWebText10K main"),
+        metrics_row("openwebtext10k_main_interaction", "OpenWebText10K main"),
+        metrics_row("openwebtext10k_plus_5m_base", "OpenWebText10K + 5M"),
+        metrics_row("openwebtext10k_plus_5m_interaction", "OpenWebText10K + 5M"),
         metrics_row("tinystories_all_base", "current TinyStories"),
         metrics_row("tinystories_all_interaction", "current TinyStories"),
         metrics_row("tinystories_all_quadratic", "current TinyStories"),
         "",
         "### Reading",
         "",
-        "- The previous local regime supports the interaction form: adding `D*x*y`",
+        "- The OpenWebText10K regime supports the interaction form: adding `D*x*y`",
         "  reduces MAE from `0.0389` to `0.0148` on the local+5M cells.",
         "- The current TinyStories regime also supports the interaction form: MAE",
         "  drops from `0.0435` to `0.0180`.",
@@ -271,7 +271,7 @@ def main() -> None:
             "## Decision",
             "",
             "The previous regime validation does not block the current plan. It strengthens",
-            "the formula-family claim because both the old local regime and the current",
+            "the formula-family claim because both the OpenWebText10K regime and the current",
             "TinyStories regime prefer the interaction pressure law over first-order ABC.",
             "",
             "The validated claim remains:",