Thibaut Forest Claude Fable 5 commited on
Commit ·
67d461d
1
Parent(s): c91595d
Campaign 3 CLOSED: ~45 candidates, frontier confirmed as pipeline ceiling; autopsy prize unreachable by ordering; alpha deflated (sign-test refusal); xlb micro-piece shelved; team-repo intel (Phase 60)
Browse files- EXPERIMENTS.md +33 -0
- agent_reports_bgkf/c3_findings.md +45 -3
EXPERIMENTS.md
CHANGED
|
@@ -3249,3 +3249,36 @@ Private-selection matrix as of this phase: candidate head = 3f9bf12 (FT2
|
|
| 3249 |
frontier); fallback = 3c7b883 (measured 1661.45); never 698401a (1877.08).
|
| 3250 |
The user manually triggers public scoring; a public look at 3f9bf12 prices
|
| 3251 |
the residual ghost/composition risk the CV cannot see (phase 58).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3249 |
frontier); fallback = 3c7b883 (measured 1661.45); never 698401a (1877.08).
|
| 3250 |
The user manually triggers public scoring; a public look at 3f9bf12 prices
|
| 3251 |
the residual ghost/composition risk the CV cannot see (phase 58).
|
| 3252 |
+
|
| 3253 |
+
## Phase 60 - campaign 3: exhaustive post-frontier exploration; frontier confirmed as the pipeline ceiling
|
| 3254 |
+
|
| 3255 |
+
User directive: improve the champion CV further, radical options included,
|
| 3256 |
+
review all assumptions (podium context: team-repo scale ~1400). ~45
|
| 3257 |
+
candidates over 7 waves + 2 device-level autopsies + full mining of the
|
| 3258 |
+
team repo (rul-mgt-zero, 1493.65 public vs our 1661.45). Full detail:
|
| 3259 |
+
agent_reports_bgkf/c3_findings.md.
|
| 3260 |
+
|
| 3261 |
+
KEY FINDINGS:
|
| 3262 |
+
1. AUTOPSY overturns the silent-death assumption: frontier recall is 48%;
|
| 3263 |
+
237 missed deaths at median rank 5 (gap quartiles 2/3/8 below a ~rank-2
|
| 3264 |
+
cutoff) carry 70% of remaining cost; only 45/237 are voltage-silent.
|
| 3265 |
+
False includes are plateau devices at 2.41-2.44V for 40+ days (36% die,
|
| 3266 |
+
median 83d — just outside the window). The prize is top-band ordering.
|
| 3267 |
+
2. No candidate reaches it: every feature/order/model/count axis measured;
|
| 3268 |
+
best survivor is a -6-point crossing-label micro-piece (xlb, Wilcoxon
|
| 3269 |
+
.0475, shelved). ft2 (1688.4, 3f9bf12) is the ceiling of this pipeline
|
| 3270 |
+
under the count-clean bar.
|
| 3271 |
+
3. Appetite re-audited and re-closed: alpha 1.0 reads -64.5 mean but
|
| 3272 |
+
17W/24L, Wilcoxon .375 — warmup-carried count redistribution; gap-band
|
| 3273 |
+
precision ~11% < ~16% break-even.
|
| 3274 |
+
4. Team repo decoded: their edge = multi-level self-supervised targets +
|
| 3275 |
+
poskeep_target sampling (-155.6, not portable — we already train on all
|
| 3276 |
+
rows) + CP-SAT planner over all nine cost components. Their CV is
|
| 3277 |
+
in-fleet (1412.6 not comparable to our held-out 1688.4). Direct feature
|
| 3278 |
+
transplant fails in our model form (+15..+167). Cross-pollination
|
| 3279 |
+
candidates TO them: WienerFHT order blend, vmin7_rank, building-held-out
|
| 3280 |
+
transfer check; their gen-10 state-dependent dV/dT (resistance channel)
|
| 3281 |
+
is the strongest open lead anywhere.
|
| 3282 |
+
|
| 3283 |
+
STANDING RECOMMENDATION unchanged: public-trigger 3f9bf12/head; private =
|
| 3284 |
+
3f9bf12 unless publicly refuted, else 3c7b883; never 698401a.
|
agent_reports_bgkf/c3_findings.md
CHANGED
|
@@ -81,6 +81,48 @@ measures the SHAPE of the approach.
|
|
| 81 |
vmin7_rank, and a building-held-out transfer check (their harness cannot
|
| 82 |
see cross-fleet failure; ours was built for it).
|
| 83 |
|
| 84 |
-
## Wave X (
|
| 85 |
-
|
| 86 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
vmin7_rank, and a building-held-out transfer check (their harness cannot
|
| 82 |
see cross-fleet failure; ours was built for it).
|
| 83 |
|
| 84 |
+
## Wave X results (closes the radical lanes)
|
| 85 |
+
|
| 86 |
+
| candidate | vs ft2 | verdict |
|
| 87 |
+
|---|---|---|
|
| 88 |
+
| xlb (crossing-label logistic, w=.15-.20 in order) | -5.8 ± 14.3, 15W/3L, Wilcoxon .0475 | REAL micro-piece, see below |
|
| 89 |
+
| xhgb / xhgb35 (crossing-label HGB) | +39 / +285 | dead; capacity hurts cross-fleet |
|
| 90 |
+
| acc (rttt_accel knee compounding) | +66 | dead in our form |
|
| 91 |
+
| raw / rawo (raw-trajectory HGB) | +136..+167 | dead |
|
| 92 |
+
| costo (cost-weighted logbag order) | +25 | dead |
|
| 93 |
+
|
| 94 |
+
xlb bowl: w .10 -4.5 (.074) / .15 -5.8 (.0475) / .20 -6.1 (.0505) /
|
| 95 |
+
.30 +23. A genuine, sign-consistent ~-6-point effect from self-supervised
|
| 96 |
+
crossing labels (the one team-repo structural idea that survived
|
| 97 |
+
transplant) — but 0.4 sigma on the mean, tie-dominated. SHELF: not worth a
|
| 98 |
+
new deployment code path on deadline day; the recipe is
|
| 99 |
+
XrossOrder in /tmp/c3/run6.py (labels = 7d-median crosses 2.50 within 42d;
|
| 100 |
+
logistic on vm7 features at weight .15 inside the order blend).
|
| 101 |
+
|
| 102 |
+
## ALPHA DEFLATED (correction to the audit section above)
|
| 103 |
+
|
| 104 |
+
Scrutiny kills the appetite lever even locally: alpha 1.0 is 17W/24L,
|
| 105 |
+
Wilcoxon 0.375 — most scenarios get WORSE; the -64.5 mean is a few
|
| 106 |
+
warmup-heavy saves (count-redistribution, the phase-56 signature). The
|
| 107 |
+
gap-band precision ~11% sits below the ~16% break-even, exactly as the
|
| 108 |
+
phase-58-era memory recorded. Appetite stays CLOSED on local evidence too.
|
| 109 |
+
|
| 110 |
+
## CAMPAIGN 3 CONCLUSION (~45 candidates, 2 autopsies, team-repo mining)
|
| 111 |
+
|
| 112 |
+
**The frontier stands: ft2 = 1688.4 (commit 3f9bf12) is the ceiling of
|
| 113 |
+
this pipeline under the count-clean bar.** Every axis is now measured:
|
| 114 |
+
composition/weights/windows (plateau at shipped values), feature space
|
| 115 |
+
(level, shape, rank, aux, physics, contagion, team-port), order sources
|
| 116 |
+
(RankNet, HGB, dthaz, gbm, sim, raw-trajectory, cost-weighted,
|
| 117 |
+
crossing-label), sampling (tr lane), planner (pl lane + day_q 0.0),
|
| 118 |
+
appetite (deflated). The near-miss prize the autopsy exposed (211 deaths
|
| 119 |
+
at rank-gap 1-10, 3,593 late-days) is real but unreachable by any
|
| 120 |
+
ordering candidate tested — the false includes are genuinely
|
| 121 |
+
harder-looking devices; separating plateau-at-threshold from fast-crossers
|
| 122 |
+
needs information this fleet's 82 labels cannot teach cross-building.
|
| 123 |
+
|
| 124 |
+
**The podium path is the TEAM repo** (1493.65 public vs our 1661.45):
|
| 125 |
+
its multi-level supervision + CP-SAT planner is a structurally better
|
| 126 |
+
pipeline. Recommended relays: our WienerFHT order blend, vmin7_rank, a
|
| 127 |
+
building-held-out transfer check, and their own gen-10 resistance channel
|
| 128 |
+
(state-dependent dV/dT) as the strongest open lead there.
|