Thibaut Forest Claude Fable 5 commited on
Commit
67d461d
·
1 Parent(s): c91595d

Campaign 3 CLOSED: ~45 candidates, frontier confirmed as pipeline ceiling; autopsy prize unreachable by ordering; alpha deflated (sign-test refusal); xlb micro-piece shelved; team-repo intel (Phase 60)

Browse files
Files changed (2) hide show
  1. EXPERIMENTS.md +33 -0
  2. agent_reports_bgkf/c3_findings.md +45 -3
EXPERIMENTS.md CHANGED
@@ -3249,3 +3249,36 @@ Private-selection matrix as of this phase: candidate head = 3f9bf12 (FT2
3249
  frontier); fallback = 3c7b883 (measured 1661.45); never 698401a (1877.08).
3250
  The user manually triggers public scoring; a public look at 3f9bf12 prices
3251
  the residual ghost/composition risk the CV cannot see (phase 58).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3249
  frontier); fallback = 3c7b883 (measured 1661.45); never 698401a (1877.08).
3250
  The user manually triggers public scoring; a public look at 3f9bf12 prices
3251
  the residual ghost/composition risk the CV cannot see (phase 58).
3252
+
3253
+ ## Phase 60 - campaign 3: exhaustive post-frontier exploration; frontier confirmed as the pipeline ceiling
3254
+
3255
+ User directive: improve the champion CV further, radical options included,
3256
+ review all assumptions (podium context: team-repo scale ~1400). ~45
3257
+ candidates over 7 waves + 2 device-level autopsies + full mining of the
3258
+ team repo (rul-mgt-zero, 1493.65 public vs our 1661.45). Full detail:
3259
+ agent_reports_bgkf/c3_findings.md.
3260
+
3261
+ KEY FINDINGS:
3262
+ 1. AUTOPSY overturns the silent-death assumption: frontier recall is 48%;
3263
+ 237 missed deaths at median rank 5 (gap quartiles 2/3/8 below a ~rank-2
3264
+ cutoff) carry 70% of remaining cost; only 45/237 are voltage-silent.
3265
+ False includes are plateau devices at 2.41-2.44V for 40+ days (36% die,
3266
+ median 83d — just outside the window). The prize is top-band ordering.
3267
+ 2. No candidate reaches it: every feature/order/model/count axis measured;
3268
+ best survivor is a -6-point crossing-label micro-piece (xlb, Wilcoxon
3269
+ .0475, shelved). ft2 (1688.4, 3f9bf12) is the ceiling of this pipeline
3270
+ under the count-clean bar.
3271
+ 3. Appetite re-audited and re-closed: alpha 1.0 reads -64.5 mean but
3272
+ 17W/24L, Wilcoxon .375 — warmup-carried count redistribution; gap-band
3273
+ precision ~11% < ~16% break-even.
3274
+ 4. Team repo decoded: their edge = multi-level self-supervised targets +
3275
+ poskeep_target sampling (-155.6, not portable — we already train on all
3276
+ rows) + CP-SAT planner over all nine cost components. Their CV is
3277
+ in-fleet (1412.6 not comparable to our held-out 1688.4). Direct feature
3278
+ transplant fails in our model form (+15..+167). Cross-pollination
3279
+ candidates TO them: WienerFHT order blend, vmin7_rank, building-held-out
3280
+ transfer check; their gen-10 state-dependent dV/dT (resistance channel)
3281
+ is the strongest open lead anywhere.
3282
+
3283
+ STANDING RECOMMENDATION unchanged: public-trigger 3f9bf12/head; private =
3284
+ 3f9bf12 unless publicly refuted, else 3c7b883; never 698401a.
agent_reports_bgkf/c3_findings.md CHANGED
@@ -81,6 +81,48 @@ measures the SHAPE of the approach.
81
  vmin7_rank, and a building-held-out transfer check (their harness cannot
82
  see cross-fleet failure; ours was built for it).
83
 
84
- ## Wave X (in flight): crossing-label order sources (self-supervised
85
- ## x25-in-42d, logbag + HGB forms), rttt_accel, raw-trajectory HGB,
86
- ## cost-weighted order. Results appended on completion.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81
  vmin7_rank, and a building-held-out transfer check (their harness cannot
82
  see cross-fleet failure; ours was built for it).
83
 
84
+ ## Wave X results (closes the radical lanes)
85
+
86
+ | candidate | vs ft2 | verdict |
87
+ |---|---|---|
88
+ | xlb (crossing-label logistic, w=.15-.20 in order) | -5.8 ± 14.3, 15W/3L, Wilcoxon .0475 | REAL micro-piece, see below |
89
+ | xhgb / xhgb35 (crossing-label HGB) | +39 / +285 | dead; capacity hurts cross-fleet |
90
+ | acc (rttt_accel knee compounding) | +66 | dead in our form |
91
+ | raw / rawo (raw-trajectory HGB) | +136..+167 | dead |
92
+ | costo (cost-weighted logbag order) | +25 | dead |
93
+
94
+ xlb bowl: w .10 -4.5 (.074) / .15 -5.8 (.0475) / .20 -6.1 (.0505) /
95
+ .30 +23. A genuine, sign-consistent ~-6-point effect from self-supervised
96
+ crossing labels (the one team-repo structural idea that survived
97
+ transplant) — but 0.4 sigma on the mean, tie-dominated. SHELF: not worth a
98
+ new deployment code path on deadline day; the recipe is
99
+ XrossOrder in /tmp/c3/run6.py (labels = 7d-median crosses 2.50 within 42d;
100
+ logistic on vm7 features at weight .15 inside the order blend).
101
+
102
+ ## ALPHA DEFLATED (correction to the audit section above)
103
+
104
+ Scrutiny kills the appetite lever even locally: alpha 1.0 is 17W/24L,
105
+ Wilcoxon 0.375 — most scenarios get WORSE; the -64.5 mean is a few
106
+ warmup-heavy saves (count-redistribution, the phase-56 signature). The
107
+ gap-band precision ~11% sits below the ~16% break-even, exactly as the
108
+ phase-58-era memory recorded. Appetite stays CLOSED on local evidence too.
109
+
110
+ ## CAMPAIGN 3 CONCLUSION (~45 candidates, 2 autopsies, team-repo mining)
111
+
112
+ **The frontier stands: ft2 = 1688.4 (commit 3f9bf12) is the ceiling of
113
+ this pipeline under the count-clean bar.** Every axis is now measured:
114
+ composition/weights/windows (plateau at shipped values), feature space
115
+ (level, shape, rank, aux, physics, contagion, team-port), order sources
116
+ (RankNet, HGB, dthaz, gbm, sim, raw-trajectory, cost-weighted,
117
+ crossing-label), sampling (tr lane), planner (pl lane + day_q 0.0),
118
+ appetite (deflated). The near-miss prize the autopsy exposed (211 deaths
119
+ at rank-gap 1-10, 3,593 late-days) is real but unreachable by any
120
+ ordering candidate tested — the false includes are genuinely
121
+ harder-looking devices; separating plateau-at-threshold from fast-crossers
122
+ needs information this fleet's 82 labels cannot teach cross-building.
123
+
124
+ **The podium path is the TEAM repo** (1493.65 public vs our 1661.45):
125
+ its multi-level supervision + CP-SAT planner is a structurally better
126
+ pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
127
+ building-held-out transfer check, and their own gen-10 resistance channel
128
+ (state-dependent dV/dT) as the strongest open lead there.