Thibaut Forest Claude Opus 5 (1M context) commited on
Commit ·
e382bfa
1
Parent(s): 54b578c
Phase 48: public refutes cert-first (+43.19, ghost force-swaps at ~111 early-days each); default off
Browse files- EXPERIMENTS.md +44 -0
- batteryswap_example/submit.py +8 -1
EXPERIMENTS.md
CHANGED
|
@@ -2587,3 +2587,47 @@ k-sweep (k=1 +291, k=2 +200), cert-first works ONLY at the label process's
|
|
| 2587 |
exact parameters (2.40 V, 3 consecutive gated readings). The mechanism is
|
| 2588 |
label-rule replay on past data, not prediction; any deviation reverts to
|
| 2589 |
guessing at sub-break-even precision. Direction closed.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2587 |
exact parameters (2.40 V, 3 consecutive gated readings). The mechanism is
|
| 2588 |
label-rule replay on past data, not prediction; any deviation reverts to
|
| 2589 |
guessing at sub-break-even precision. Direction closed.
|
| 2590 |
+
|
| 2591 |
+
## Phase 48 - PUBLIC REFUTES cert-first (1704.64); the third and sharpest CV failure
|
| 2592 |
+
|
| 2593 |
+
Submission 9438aac (cert-first isolated, pooling default off): **1704.64 vs
|
| 2594 |
+
champion 1661.45, +43.19.** Inversion (all integers - settings unchanged):
|
| 2595 |
+
|
| 2596 |
+
| | swaps | late-days | early-days | total |
|
| 2597 |
+
|---|---|---|---|---|
|
| 2598 |
+
| champion 3c7b883 | 580 | 5819 | 13197 | 1661.45 |
|
| 2599 |
+
| cert-first 9438aac | 598 | 5894 | 15203 | 1704.64 |
|
| 2600 |
+
| delta | **+18** | +75 | **+2006** | +43.19 |
|
| 2601 |
+
|
| 2602 |
+
**+18 swaps at ~111 early-days each.** The diagnosis writes itself: on train,
|
| 2603 |
+
every device that sustains <2.40 V dies within 90 days (54/54, phase 46), so
|
| 2604 |
+
the boost was loss-free locally. The public fleet contains devices that
|
| 2605 |
+
sustain-cross and NEVER receive an EOL label - the ghost population phase 15
|
| 2606 |
+
found 26 of in train (at 2.45-2.48; train has none at 2.40, public evidently
|
| 2607 |
+
does). A ghost is force-swapped in every scenario it survives, and with no
|
| 2608 |
+
EOL on file the evaluator prices each swap against end_time+30: ~111
|
| 2609 |
+
early-days apiece. The count rule could not protect us - a boosted device
|
| 2610 |
+
displaces a marginal pick, and when the displaced pick sits in the break-even
|
| 2611 |
+
top-up set it re-enters, so the union grows.
|
| 2612 |
+
|
| 2613 |
+
The premise that failed is not the label rule (81/82 exact) but its
|
| 2614 |
+
CONVERSE on an unseen fleet: "crossed implies labeled-dead-soon" is a
|
| 2615 |
+
train-fleet fact, not a label-process fact.
|
| 2616 |
+
|
| 2617 |
+
### What this makes three of
|
| 2618 |
+
|
| 2619 |
+
Locally-validated interventions refuted by public: ALPHA_STATIC=1.5 (holdout
|
| 2620 |
+
-240 -> public +527), cliff boost (adjudicated -55 -> refuted stacked), and
|
| 2621 |
+
now cert-first (**-37.9 at 3W/0L/45T -> public +43.2**). Cert-first is the
|
| 2622 |
+
sharpest of the three: mechanistically derived, past-only, loss-free on every
|
| 2623 |
+
local instrument, refuted anyway - by a fleet-composition fact no local
|
| 2624 |
+
protocol can exhibit because train contains zero counterexamples. When the
|
| 2625 |
+
local evidence for a class of intervention is this good and it still fails,
|
| 2626 |
+
the class is uninsurable, not under-validated.
|
| 2627 |
+
|
| 2628 |
+
Action: CERT_FIRST default off (code retained behind the env var); champion
|
| 2629 |
+
remains 3c7b883 at 1661.45 on the board (best-per-account row unaffected).
|
| 2630 |
+
A recency-guarded variant (trust the crossing only while fresh) is measured
|
| 2631 |
+
locally in this phase's sweep, but shipping it would repeat the same bet with
|
| 2632 |
+
a smaller stake and no way to price it - the ghost rate at 2.40 on the scored
|
| 2633 |
+
fleets is unobservable from here.
|
batteryswap_example/submit.py
CHANGED
|
@@ -165,7 +165,14 @@ CLIFF_MIN_N = 20
|
|
| 165 |
# confirmation depth is load-bearing: k=1 (+291) and k=2 (+200) admit
|
| 166 |
# recoveries; k=3 - the label rule's own sustain - is the unique safe point.
|
| 167 |
# Past-only by construction: the flag requires all 3 readings <= T.
|
| 168 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 169 |
CERT_V = 2.40
|
| 170 |
CERT_SUS = 3
|
| 171 |
|
|
|
|
| 165 |
# confirmation depth is load-bearing: k=1 (+291) and k=2 (+200) admit
|
| 166 |
# recoveries; k=3 - the label rule's own sustain - is the unique safe point.
|
| 167 |
# Past-only by construction: the flag requires all 3 readings <= T.
|
| 168 |
+
# PUBLIC REFUTED (2026-08-22, submission 9438aac: 1704.64 vs 1661.45, +43.19).
|
| 169 |
+
# Inversion: +18 swaps at ~111 early-days each, late +15.6. On train every
|
| 170 |
+
# sustained-crossing device dies by +90d (54/54), so the boost was loss-free
|
| 171 |
+
# locally; the public fleet contains crossed-but-NEVER-LABELED devices
|
| 172 |
+
# (ghosts), each force-swapped repeatedly and priced against end_time+30.
|
| 173 |
+
# Third consecutive locally-validated intervention refuted by public
|
| 174 |
+
# (ALPHA_STATIC=1.5, cliff boost, cert-first). Default OFF.
|
| 175 |
+
CERT_FIRST = os.environ.get('BATTERYSWAP_CERT_FIRST', '0') != '0'
|
| 176 |
CERT_V = 2.40
|
| 177 |
CERT_SUS = 3
|
| 178 |
|