Thibaut Forest Claude Fable 5 commited on
Commit
8107fda
·
1 Parent(s): b8318dc

phase 73: alpha 1.4 converts publicly (1480.85, -94.5); selection = 62e9d91; REPRODUCIBILITY table updated

Browse files
Files changed (2) hide show
  1. EXPERIMENTS.md +24 -0
  2. REPRODUCIBILITY.md +4 -3
EXPERIMENTS.md CHANGED
@@ -3644,3 +3644,27 @@ byte-identical to env-override run. Old-ordering alpha 1.5 failure
3644
  (2189) predates ft2 - this is the operating-point hypothesis' first
3645
  test on the current ordering. DECISION RULE: public < 1575.31 -> select
3646
  62e9d91; else select 4c93883. Revert = both alpha defaults 1.0.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3644
  (2189) predates ft2 - this is the operating-point hypothesis' first
3645
  test on the current ordering. DECISION RULE: public < 1575.31 -> select
3646
  62e9d91; else select 4c93883. Revert = both alpha defaults 1.0.
3647
+
3648
+ ## Phase 73 - PUBLIC CONVERTS alpha 1.4: 1480.85 (-94.5) - both pre-registered gates pass; SELECTION = 62e9d91
3649
+
3650
+ User-triggered public read of 62e9d91: total 1480.85 vs 1575.31
3651
+ (4c93883). Pre-registered decision rule (phase 72): margin >= 15 AND
3652
+ late-swap fingerprint (late down >= 100). Both pass decisively:
3653
+ - margin -94.46 (6x threshold); components invert to integers (clean).
3654
+ - swaps 747 (+103, 15.6/scen - INTO the podium band 15-17.6);
3655
+ - late-days 4006 (-1003; component -208.96 = 2x the required
3656
+ fingerprint) - the marginal-rank batteries DO contain real deaths on
3657
+ held-out fleets: ~0.8 extra catches/scenario at a strongly
3658
+ profitable exchange (early +115.35, ops -1.40 flat).
3659
+ FIRST large count-coupled public conversion (family was 0-for-4; the
3660
+ old "ranks 13-20 convert at ~0%" verdict was an OLD-ordering fact -
3661
+ the ft2 ordering's marginal band converts). The public-overfit
3662
+ objection was pre-answered: single pre-registered hypothesis from
3663
+ external evidence (podium operating points + bgkf -43), component
3664
+ fingerprint predicted before the read, margin rule against collision
3665
+ noise. By sibling-split exchangeability the effect transfers to
3666
+ private. SELECTION: 62e9d91 (public 1480.85) PRIMARY; 4c93883
3667
+ (1575.31) fallback slot. Dose-response CV (alpha 1.6/1.8/2.0) running
3668
+ to decide whether ONE more A/B is justified - stopping rule: only if
3669
+ the CV curve is still falling at 1.6+; iterating alpha values on
3670
+ public beyond one more point = the probing pattern we reject.
REPRODUCIBILITY.md CHANGED
@@ -12,12 +12,13 @@ selection:
12
 
13
  | commit | public score | configuration (env defaults at that commit) |
14
  |---|---|---|
15
- | `4c93883` | **1575.31** | primary selection — order .50 logbag + .30 Wiener + .20 gapHGB, alpha 1.0, planner split_days=7 / timing_weight=1.0 |
16
- | `71bfff2` | 1583.11 | alternate — same model, planner split_days=3 / timing_weight=2.0 (equivalent to `60d65da`; warmup gate present in code but OFF by default) |
 
17
  | `e4745d2` | 1594.89 | not selected — warmup gate ON (refuted by the public score) |
18
 
19
  The exact submitted commit is the one recorded in the competition portal at
20
- selection time; unless stated otherwise there, it is `4c93883`.
21
 
22
  ## Pipeline: what is trained, and when
23
 
 
12
 
13
  | commit | public score | configuration (env defaults at that commit) |
14
  |---|---|---|
15
+ | `62e9d91` | **1480.85** | primary selection — order .50 logbag + .30 Wiener + .20 gapHGB, alpha 1.4, planner split_days=3 / timing_weight=2.0 |
16
+ | `4c93883` | 1575.31 | fallback — same ordering, alpha 1.0, planner split_days=7 / timing_weight=1.0 |
17
+ | `71bfff2` | 1583.11 | not selected — alpha 1.0, planner split_days=3 / timing_weight=2.0 (equivalent to `60d65da`) |
18
  | `e4745d2` | 1594.89 | not selected — warmup gate ON (refuted by the public score) |
19
 
20
  The exact submitted commit is the one recorded in the competition portal at
21
+ selection time; unless stated otherwise there, it is `62e9d91`.
22
 
23
  ## Pipeline: what is trained, and when
24