Thibaut Forest Claude Fable 5 commited on
Commit
4d3b32e
·
1 Parent(s): 7330221

EXPERIMENTS: Phase 61 entry

Browse files

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Files changed (1) hide show
  1. EXPERIMENTS.md +23 -0
EXPERIMENTS.md CHANGED
@@ -3282,3 +3282,26 @@ KEY FINDINGS:
3282
 
3283
  STANDING RECOMMENDATION unchanged: public-trigger 3f9bf12/head; private =
3284
  3f9bf12 unless publicly refuted, else 3c7b883; never 698401a.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3282
 
3283
  STANDING RECOMMENDATION unchanged: public-trigger 3f9bf12/head; private =
3284
  3f9bf12 unless publicly refuted, else 3c7b883; never 698401a.
3285
+
3286
+ ## Phase 61 - team solution evaluated ON our bgkf; operating-point finding; alpha-1.0 A/B prepared
3287
+
3288
+ User directive: run the team repo's stack under our CV and adopt structural
3289
+ changes if they improve it. Full port (panel rebuilt on our dataset with
3290
+ 81/81 exact EOL reproduction; model retrained building-OOF, h42 AUC 0.961;
3291
+ CP-SAT planner) plus four mix-and-match decompositions. NO ADOPTION:
3292
+ their full stack +228 vs ft2 (p .017, over-buys on ~90-device fold
3293
+ fleets); their ordering loses decisively anchored (+412, monotone
3294
+ dose-response at every weight); our ft2 model driving their CP-SAT lands
3295
+ at -96.3 mean but 16.4 swaps/scen, 25W/23L, Wilcoxon .72 = count-carried,
3296
+ mean-only. Instrument caveat recorded: their machinery targets 460-920
3297
+ device fleets; our folds are ~90 - public is the only cross-pipeline
3298
+ arbiter (them 1493.65 vs us 1661.45).
3299
+
3300
+ OPERATING-POINT FINDING (leaderboard decomposition): the entire podium
3301
+ swaps 15-17.6/scenario with ~60-70 late-days/scen vs our 12.1 swaps and
3302
+ 121 late-days; the CP-SAT mix independently lands at the podium's
3303
+ operating point on our predictions. The alpha-1.5 public failure (6ea03da,
3304
+ zero catches) was on the OLD ordering; whether ft2's ordering converts
3305
+ extra appetite publicly is the one open question a public trigger can
3306
+ answer. PREPARED: commit 296f8f2 = alpha 1.0 on ft2 (single variable,
3307
+ selectable for public scoring); head 7d7632c keeps the safe 0.8.