Thibaut Forest Claude Fable 5 commited on
Commit ·
8107fda
1
Parent(s): b8318dc
phase 73: alpha 1.4 converts publicly (1480.85, -94.5); selection = 62e9d91; REPRODUCIBILITY table updated
Browse files- EXPERIMENTS.md +24 -0
- REPRODUCIBILITY.md +4 -3
EXPERIMENTS.md
CHANGED
|
@@ -3644,3 +3644,27 @@ byte-identical to env-override run. Old-ordering alpha 1.5 failure
|
|
| 3644 |
(2189) predates ft2 - this is the operating-point hypothesis' first
|
| 3645 |
test on the current ordering. DECISION RULE: public < 1575.31 -> select
|
| 3646 |
62e9d91; else select 4c93883. Revert = both alpha defaults 1.0.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3644 |
(2189) predates ft2 - this is the operating-point hypothesis' first
|
| 3645 |
test on the current ordering. DECISION RULE: public < 1575.31 -> select
|
| 3646 |
62e9d91; else select 4c93883. Revert = both alpha defaults 1.0.
|
| 3647 |
+
|
| 3648 |
+
## Phase 73 - PUBLIC CONVERTS alpha 1.4: 1480.85 (-94.5) - both pre-registered gates pass; SELECTION = 62e9d91
|
| 3649 |
+
|
| 3650 |
+
User-triggered public read of 62e9d91: total 1480.85 vs 1575.31
|
| 3651 |
+
(4c93883). Pre-registered decision rule (phase 72): margin >= 15 AND
|
| 3652 |
+
late-swap fingerprint (late down >= 100). Both pass decisively:
|
| 3653 |
+
- margin -94.46 (6x threshold); components invert to integers (clean).
|
| 3654 |
+
- swaps 747 (+103, 15.6/scen - INTO the podium band 15-17.6);
|
| 3655 |
+
- late-days 4006 (-1003; component -208.96 = 2x the required
|
| 3656 |
+
fingerprint) - the marginal-rank batteries DO contain real deaths on
|
| 3657 |
+
held-out fleets: ~0.8 extra catches/scenario at a strongly
|
| 3658 |
+
profitable exchange (early +115.35, ops -1.40 flat).
|
| 3659 |
+
FIRST large count-coupled public conversion (family was 0-for-4; the
|
| 3660 |
+
old "ranks 13-20 convert at ~0%" verdict was an OLD-ordering fact -
|
| 3661 |
+
the ft2 ordering's marginal band converts). The public-overfit
|
| 3662 |
+
objection was pre-answered: single pre-registered hypothesis from
|
| 3663 |
+
external evidence (podium operating points + bgkf -43), component
|
| 3664 |
+
fingerprint predicted before the read, margin rule against collision
|
| 3665 |
+
noise. By sibling-split exchangeability the effect transfers to
|
| 3666 |
+
private. SELECTION: 62e9d91 (public 1480.85) PRIMARY; 4c93883
|
| 3667 |
+
(1575.31) fallback slot. Dose-response CV (alpha 1.6/1.8/2.0) running
|
| 3668 |
+
to decide whether ONE more A/B is justified - stopping rule: only if
|
| 3669 |
+
the CV curve is still falling at 1.6+; iterating alpha values on
|
| 3670 |
+
public beyond one more point = the probing pattern we reject.
|
REPRODUCIBILITY.md
CHANGED
|
@@ -12,12 +12,13 @@ selection:
|
|
| 12 |
|
| 13 |
| commit | public score | configuration (env defaults at that commit) |
|
| 14 |
|---|---|---|
|
| 15 |
-
| `
|
| 16 |
-
| `
|
|
|
|
| 17 |
| `e4745d2` | 1594.89 | not selected — warmup gate ON (refuted by the public score) |
|
| 18 |
|
| 19 |
The exact submitted commit is the one recorded in the competition portal at
|
| 20 |
-
selection time; unless stated otherwise there, it is `
|
| 21 |
|
| 22 |
## Pipeline: what is trained, and when
|
| 23 |
|
|
|
|
| 12 |
|
| 13 |
| commit | public score | configuration (env defaults at that commit) |
|
| 14 |
|---|---|---|
|
| 15 |
+
| `62e9d91` | **1480.85** | primary selection — order .50 logbag + .30 Wiener + .20 gapHGB, alpha 1.4, planner split_days=3 / timing_weight=2.0 |
|
| 16 |
+
| `4c93883` | 1575.31 | fallback — same ordering, alpha 1.0, planner split_days=7 / timing_weight=1.0 |
|
| 17 |
+
| `71bfff2` | 1583.11 | not selected — alpha 1.0, planner split_days=3 / timing_weight=2.0 (equivalent to `60d65da`) |
|
| 18 |
| `e4745d2` | 1594.89 | not selected — warmup gate ON (refuted by the public score) |
|
| 19 |
|
| 20 |
The exact submitted commit is the one recorded in the competition portal at
|
| 21 |
+
selection time; unless stated otherwise there, it is `62e9d91`.
|
| 22 |
|
| 23 |
## Pipeline: what is trained, and when
|
| 24 |
|