Thibaut Forest Claude Fable 5 commited on
Commit ·
7330221
1
Parent(s): 7d7632c
Phase 61 findings: team stack on bgkf (no adoption, all count-channel); operating-point analysis (podium swaps 15-17.6 vs our 12.1); alpha-1.0 A/B commit prepared
Browse files
agent_reports_bgkf/c3_findings.md
CHANGED
|
@@ -126,3 +126,44 @@ its multi-level supervision + CP-SAT planner is a structurally better
|
|
| 126 |
pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
|
| 127 |
building-held-out transfer check, and their own gen-10 resistance channel
|
| 128 |
(state-dependent dV/dT) as the strongest open lead there.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 126 |
pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
|
| 127 |
building-held-out transfer check, and their own gen-10 resistance channel
|
| 128 |
(state-dependent dV/dT) as the strongest open lead there.
|
| 129 |
+
|
| 130 |
+
## Team solution ON our bgkf (user directive; phase 61)
|
| 131 |
+
|
| 132 |
+
Full port: their panel rebuilt from our dataset (EOL reproduction 81/81
|
| 133 |
+
exact), their model retrained (building-OOF, h=42 AUC 0.961), their CP-SAT
|
| 134 |
+
planner. All arms on our exact protocol (5 snake folds, test fleets
|
| 135 |
+
standalone, folds summed):
|
| 136 |
+
|
| 137 |
+
| arm | SCORE | vs ft2 | swaps/scen | verdict |
|
| 138 |
+
|---|---|---|---|---|
|
| 139 |
+
| their FULL stack (rs 1.0) | 1916.6 | +228.3, p.017 | 13.2 | planner over-buys on ~90-device fleets |
|
| 140 |
+
| their model -> our planner (raw) | — | +509.7, p<.001 | 7.6 | at-risk gate starves our count rule |
|
| 141 |
+
| their ORDER, anchored on ft2 values | — | +412.1, p<.001 | 9.4 | their ordering loses decisively cross-fleet here |
|
| 142 |
+
| 30% their order | — | +149.1, p.015 | 9.6 | monotone dose-response, all bad |
|
| 143 |
+
| 20% in 3-way with wiener | — | +59.9 n.s. | 9.6 | |
|
| 144 |
+
| **our ft2 model -> their CP-SAT** | **1592.0** | **-96.3 ± 69.2, wilcoxon .72** | **16.4** | mean-only, count-carried (25W/23L) |
|
| 145 |
+
|
| 146 |
+
**No structural adoption**: nothing is sign-supported, and every gain is
|
| 147 |
+
count-channel. INSTRUMENT CAVEAT both ways: their machinery targets
|
| 148 |
+
~460-920-device fleets; our folds are ~90 devices. Public (them 1493.65 vs
|
| 149 |
+
us 1661.45) remains the only cross-pipeline arbiter.
|
| 150 |
+
|
| 151 |
+
## THE OPERATING-POINT FINDING (leaderboard decomposition)
|
| 152 |
+
|
| 153 |
+
| | swaps/scen | late-days/scen | early-days/scen |
|
| 154 |
+
|---|---|---|---|
|
| 155 |
+
| J2W (1st, 1135) | 15.1 | 60 | 622 |
|
| 156 |
+
| podium (2nd-3rd) | 15.5-16.3 | 58-70 | 787-830 |
|
| 157 |
+
| team repo (1493) | 17.6 | 68 | 1086 |
|
| 158 |
+
| OURS (1661) | 12.1 | 121 | 275 |
|
| 159 |
+
|
| 160 |
+
Every team above us swaps 25-45% more and halves our late cost. Our
|
| 161 |
+
CP-SAT mix lands at 16.4 swaps locally (-96 mean) — the podium's operating
|
| 162 |
+
point, discovered independently by their solver on our predictions. The
|
| 163 |
+
alpha-1.5 public failure (6ea03da: +8 swaps/scen on the OLD plain-logbag
|
| 164 |
+
ordering, zero catches) predates the ft2 ordering. Whether ft2's ordering
|
| 165 |
+
converts extra appetite publicly is THE open question, and only a public
|
| 166 |
+
trigger can answer it. Prepared as a one-click experiment:
|
| 167 |
+
**commit 296f8f2 = alpha 1.0 on the ft2 frontier** (single variable);
|
| 168 |
+
head 7d7632c stays at the safe 0.8. Pushes are scoring-inert - 296f8f2
|
| 169 |
+
only runs if the user triggers it.
|