Thibaut Forest Claude Fable 5 commited on
Commit
7330221
·
1 Parent(s): 7d7632c

Phase 61 findings: team stack on bgkf (no adoption, all count-channel); operating-point analysis (podium swaps 15-17.6 vs our 12.1); alpha-1.0 A/B commit prepared

Browse files
Files changed (1) hide show
  1. agent_reports_bgkf/c3_findings.md +41 -0
agent_reports_bgkf/c3_findings.md CHANGED
@@ -126,3 +126,44 @@ its multi-level supervision + CP-SAT planner is a structurally better
126
  pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
127
  building-held-out transfer check, and their own gen-10 resistance channel
128
  (state-dependent dV/dT) as the strongest open lead there.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
126
  pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
127
  building-held-out transfer check, and their own gen-10 resistance channel
128
  (state-dependent dV/dT) as the strongest open lead there.
129
+
130
+ ## Team solution ON our bgkf (user directive; phase 61)
131
+
132
+ Full port: their panel rebuilt from our dataset (EOL reproduction 81/81
133
+ exact), their model retrained (building-OOF, h=42 AUC 0.961), their CP-SAT
134
+ planner. All arms on our exact protocol (5 snake folds, test fleets
135
+ standalone, folds summed):
136
+
137
+ | arm | SCORE | vs ft2 | swaps/scen | verdict |
138
+ |---|---|---|---|---|
139
+ | their FULL stack (rs 1.0) | 1916.6 | +228.3, p.017 | 13.2 | planner over-buys on ~90-device fleets |
140
+ | their model -> our planner (raw) | — | +509.7, p<.001 | 7.6 | at-risk gate starves our count rule |
141
+ | their ORDER, anchored on ft2 values | — | +412.1, p<.001 | 9.4 | their ordering loses decisively cross-fleet here |
142
+ | 30% their order | — | +149.1, p.015 | 9.6 | monotone dose-response, all bad |
143
+ | 20% in 3-way with wiener | — | +59.9 n.s. | 9.6 | |
144
+ | **our ft2 model -> their CP-SAT** | **1592.0** | **-96.3 ± 69.2, wilcoxon .72** | **16.4** | mean-only, count-carried (25W/23L) |
145
+
146
+ **No structural adoption**: nothing is sign-supported, and every gain is
147
+ count-channel. INSTRUMENT CAVEAT both ways: their machinery targets
148
+ ~460-920-device fleets; our folds are ~90 devices. Public (them 1493.65 vs
149
+ us 1661.45) remains the only cross-pipeline arbiter.
150
+
151
+ ## THE OPERATING-POINT FINDING (leaderboard decomposition)
152
+
153
+ | | swaps/scen | late-days/scen | early-days/scen |
154
+ |---|---|---|---|
155
+ | J2W (1st, 1135) | 15.1 | 60 | 622 |
156
+ | podium (2nd-3rd) | 15.5-16.3 | 58-70 | 787-830 |
157
+ | team repo (1493) | 17.6 | 68 | 1086 |
158
+ | OURS (1661) | 12.1 | 121 | 275 |
159
+
160
+ Every team above us swaps 25-45% more and halves our late cost. Our
161
+ CP-SAT mix lands at 16.4 swaps locally (-96 mean) — the podium's operating
162
+ point, discovered independently by their solver on our predictions. The
163
+ alpha-1.5 public failure (6ea03da: +8 swaps/scen on the OLD plain-logbag
164
+ ordering, zero catches) predates the ft2 ordering. Whether ft2's ordering
165
+ converts extra appetite publicly is THE open question, and only a public
166
+ trigger can answer it. Prepared as a one-click experiment:
167
+ **commit 296f8f2 = alpha 1.0 on the ft2 frontier** (single variable);
168
+ head 7d7632c stays at the safe 0.8. Pushes are scoring-inert - 296f8f2
169
+ only runs if the user triggers it.