Thibaut Forest Claude Opus 5 (1M context) commited on
Commit
e382bfa
·
1 Parent(s): 54b578c

Phase 48: public refutes cert-first (+43.19, ghost force-swaps at ~111 early-days each); default off

Browse files
Files changed (2) hide show
  1. EXPERIMENTS.md +44 -0
  2. batteryswap_example/submit.py +8 -1
EXPERIMENTS.md CHANGED
@@ -2587,3 +2587,47 @@ k-sweep (k=1 +291, k=2 +200), cert-first works ONLY at the label process's
2587
  exact parameters (2.40 V, 3 consecutive gated readings). The mechanism is
2588
  label-rule replay on past data, not prediction; any deviation reverts to
2589
  guessing at sub-break-even precision. Direction closed.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2587
  exact parameters (2.40 V, 3 consecutive gated readings). The mechanism is
2588
  label-rule replay on past data, not prediction; any deviation reverts to
2589
  guessing at sub-break-even precision. Direction closed.
2590
+
2591
+ ## Phase 48 - PUBLIC REFUTES cert-first (1704.64); the third and sharpest CV failure
2592
+
2593
+ Submission 9438aac (cert-first isolated, pooling default off): **1704.64 vs
2594
+ champion 1661.45, +43.19.** Inversion (all integers - settings unchanged):
2595
+
2596
+ | | swaps | late-days | early-days | total |
2597
+ |---|---|---|---|---|
2598
+ | champion 3c7b883 | 580 | 5819 | 13197 | 1661.45 |
2599
+ | cert-first 9438aac | 598 | 5894 | 15203 | 1704.64 |
2600
+ | delta | **+18** | +75 | **+2006** | +43.19 |
2601
+
2602
+ **+18 swaps at ~111 early-days each.** The diagnosis writes itself: on train,
2603
+ every device that sustains <2.40 V dies within 90 days (54/54, phase 46), so
2604
+ the boost was loss-free locally. The public fleet contains devices that
2605
+ sustain-cross and NEVER receive an EOL label - the ghost population phase 15
2606
+ found 26 of in train (at 2.45-2.48; train has none at 2.40, public evidently
2607
+ does). A ghost is force-swapped in every scenario it survives, and with no
2608
+ EOL on file the evaluator prices each swap against end_time+30: ~111
2609
+ early-days apiece. The count rule could not protect us - a boosted device
2610
+ displaces a marginal pick, and when the displaced pick sits in the break-even
2611
+ top-up set it re-enters, so the union grows.
2612
+
2613
+ The premise that failed is not the label rule (81/82 exact) but its
2614
+ CONVERSE on an unseen fleet: "crossed implies labeled-dead-soon" is a
2615
+ train-fleet fact, not a label-process fact.
2616
+
2617
+ ### What this makes three of
2618
+
2619
+ Locally-validated interventions refuted by public: ALPHA_STATIC=1.5 (holdout
2620
+ -240 -> public +527), cliff boost (adjudicated -55 -> refuted stacked), and
2621
+ now cert-first (**-37.9 at 3W/0L/45T -> public +43.2**). Cert-first is the
2622
+ sharpest of the three: mechanistically derived, past-only, loss-free on every
2623
+ local instrument, refuted anyway - by a fleet-composition fact no local
2624
+ protocol can exhibit because train contains zero counterexamples. When the
2625
+ local evidence for a class of intervention is this good and it still fails,
2626
+ the class is uninsurable, not under-validated.
2627
+
2628
+ Action: CERT_FIRST default off (code retained behind the env var); champion
2629
+ remains 3c7b883 at 1661.45 on the board (best-per-account row unaffected).
2630
+ A recency-guarded variant (trust the crossing only while fresh) is measured
2631
+ locally in this phase's sweep, but shipping it would repeat the same bet with
2632
+ a smaller stake and no way to price it - the ghost rate at 2.40 on the scored
2633
+ fleets is unobservable from here.
batteryswap_example/submit.py CHANGED
@@ -165,7 +165,14 @@ CLIFF_MIN_N = 20
165
  # confirmation depth is load-bearing: k=1 (+291) and k=2 (+200) admit
166
  # recoveries; k=3 - the label rule's own sustain - is the unique safe point.
167
  # Past-only by construction: the flag requires all 3 readings <= T.
168
- CERT_FIRST = os.environ.get('BATTERYSWAP_CERT_FIRST', '1') != '0'
 
 
 
 
 
 
 
169
  CERT_V = 2.40
170
  CERT_SUS = 3
171
 
 
165
  # confirmation depth is load-bearing: k=1 (+291) and k=2 (+200) admit
166
  # recoveries; k=3 - the label rule's own sustain - is the unique safe point.
167
  # Past-only by construction: the flag requires all 3 readings <= T.
168
+ # PUBLIC REFUTED (2026-08-22, submission 9438aac: 1704.64 vs 1661.45, +43.19).
169
+ # Inversion: +18 swaps at ~111 early-days each, late +15.6. On train every
170
+ # sustained-crossing device dies by +90d (54/54), so the boost was loss-free
171
+ # locally; the public fleet contains crossed-but-NEVER-LABELED devices
172
+ # (ghosts), each force-swapped repeatedly and priced against end_time+30.
173
+ # Third consecutive locally-validated intervention refuted by public
174
+ # (ALPHA_STATIC=1.5, cliff boost, cert-first). Default OFF.
175
+ CERT_FIRST = os.environ.get('BATTERYSWAP_CERT_FIRST', '0') != '0'
176
  CERT_V = 2.40
177
  CERT_SUS = 3
178