anhtld commited on
Commit
6a54bab
·
verified ·
1 Parent(s): 6967fbe

Auto-sync: 2026-06-30 03:55:26

Browse files
Files changed (1) hide show
  1. results/README.md +21 -8
results/README.md CHANGED
@@ -68,6 +68,8 @@ Use these summaries for the current paper tables:
68
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
69
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_summary.md`,
70
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
 
 
71
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_srcscorebonus0p02_summary.md`,
72
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_srcscorebonus0p02_summary.md`,
73
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_l2comp002_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
@@ -124,24 +126,30 @@ Completed deployment-clean diagnostics:
124
 
125
  Completed residual transport jobs:
126
 
127
- Last checked: `2026-06-29 21:42 UTC`. The K4 masked composed type-consensus
128
- sweep completed and produced a new clean best, 35.59%, when the exact
129
  `residual_near_miss+residual_no_op` composite is additionally masked. Pure
130
  masked composition reached 35.30%, and masked composition with the exact typed
131
  no-op prior reached 35.54%. Raw selected candidate types show no random-negative
132
  or wrong-direction composite leak. The paper table/paired analysis now use the
133
- exact compatibility-mask row as `best_clean_key`. Component-wise composite
134
  priors are negative (35.36%), and a train-source score prior on the exact
135
- compatibility chart reaches 35.48%, below the 35.59% top row. Adding the same
136
  source-score prior to the typed no-op exact-mask row reaches 35.54%, also below
137
  the top row. The mask-only exact compatibility ablation completed at 35.48%,
138
  isolating the compatibility mask from typed-prior tuning.
139
  The singleton near-miss revival diagnostic completed: exact
140
- `residual_near_miss` bonuses 0.01 and 0.02 both tie the 35.59% top row and
141
  slightly raise mean progress to 57.10%, but do not improve success.
142
  Composite-only L2 trust penalties reduce
143
  action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
144
  `0.05` reaches 35.48%, and exact compatibility + L2 `0.02` reaches 35.54%.
 
 
 
 
 
 
145
 
146
  - Code supports `--retrieval-residual-scale`, defaulting to `1.0` so the
147
  completed 32.12% result is unchanged.
@@ -293,7 +301,8 @@ action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
293
  - Jobs `14915009`/`14915013`/`14915014` completed the exact compatibility-mask
294
  GPU array, summary, and rebuild. Dropping only `near_miss+no_op` raises the
295
  clean row to 35.59% with seeds 35.30%/34.78%/36.70%, progress 57.07%, and
296
- action MSE 0.406. This is the current best clean deployment diagnostic.
 
297
  - Job `14915146` completed the CPU smoke for exact compatibility masking plus
298
  composite-only L2 trust penalty `0.02`.
299
  - Jobs `14915213`/`14915217`/`14915251` completed the exact compatibility + L2
@@ -382,9 +391,13 @@ action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
382
  - The evaluator now pads/slices residual horizons to the policy horizon
383
  defensively and deduplicates candidate-oracle actions before oracle selection;
384
  invalid padding branches cannot win. Jobs `14953513`/`14953522`/`14953524`
385
- rerun the unique-action K=8 candidate-oracle diagnostic.
 
 
 
 
386
  - Jobs `14936131`/`14936132`/`14936133` completed the compatible-chart
387
- abstention test at margin `0.10`: it reaches 34.67%, below the 35.59% top row.
388
  This rules out a naive lower-margin fix for the apparent oracle headroom.
389
 
390
  Paper table automation:
 
68
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
69
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_summary.md`,
70
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
71
+ `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_oraclek8trace_summary.md`,
72
+ `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_nmchallenger0p02_summary.md`,
73
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_srcscorebonus0p02_summary.md`,
74
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_srcscorebonus0p02_summary.md`,
75
  `h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_l2comp002_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
 
126
 
127
  Completed residual transport jobs:
128
 
129
+ Last checked: `2026-06-30 03:45 UTC`. The K4 masked composed type-consensus
130
+ sweep produced the previous clean best, 35.59%, when the exact
131
  `residual_near_miss+residual_no_op` composite is additionally masked. Pure
132
  masked composition reached 35.30%, and masked composition with the exact typed
133
  no-op prior reached 35.54%. Raw selected candidate types show no random-negative
134
  or wrong-direction composite leak. The paper table/paired analysis now use the
135
+ near-miss challenger row as `best_clean_key`. Component-wise composite
136
  priors are negative (35.36%), and a train-source score prior on the exact
137
+ compatibility chart reaches 35.48%, below the previous 35.59% compatibility row. Adding the same
138
  source-score prior to the typed no-op exact-mask row reaches 35.54%, also below
139
  the top row. The mask-only exact compatibility ablation completed at 35.48%,
140
  isolating the compatibility mask from typed-prior tuning.
141
  The singleton near-miss revival diagnostic completed: exact
142
+ `residual_near_miss` bonuses 0.01 and 0.02 both tie the previous 35.59% compatibility row and
143
  slightly raise mean progress to 57.10%, but do not improve success.
144
  Composite-only L2 trust penalties reduce
145
  action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
146
  `0.05` reaches 35.48%, and exact compatibility + L2 `0.02` reaches 35.54%.
147
+ The unique-action K=8 candidate-oracle diagnostic is complete: the archived
148
+ non-unique run remains `_nonunique`, while the deduplicated branch trace reaches
149
+ 43.07% candidate-oracle success with mean best branch rank 2.85. The resulting
150
+ trace-motivated near-miss challenger gate (`residual_near_miss`, margin 0.02)
151
+ is deployment-clean and reaches 36.00% mean success with 57.42% progress, the
152
+ current clean best.
153
 
154
  - Code supports `--retrieval-residual-scale`, defaulting to `1.0` so the
155
  completed 32.12% result is unchanged.
 
301
  - Jobs `14915009`/`14915013`/`14915014` completed the exact compatibility-mask
302
  GPU array, summary, and rebuild. Dropping only `near_miss+no_op` raises the
303
  clean row to 35.59% with seeds 35.30%/34.78%/36.70%, progress 57.07%, and
304
+ action MSE 0.406. This is the previous best clean deployment diagnostic before
305
+ the near-miss challenger gate.
306
  - Job `14915146` completed the CPU smoke for exact compatibility masking plus
307
  composite-only L2 trust penalty `0.02`.
308
  - Jobs `14915213`/`14915217`/`14915251` completed the exact compatibility + L2
 
391
  - The evaluator now pads/slices residual horizons to the policy horizon
392
  defensively and deduplicates candidate-oracle actions before oracle selection;
393
  invalid padding branches cannot win. Jobs `14953513`/`14953522`/`14953524`
394
+ completed the unique-action K=8 candidate-oracle diagnostic at 43.07%.
395
+ Jobs `14953960`/`14953961` completed the branch-trace rerun used for selector
396
+ calibration.
397
+ - Jobs `14954280`/`14954281` completed the trace-motivated near-miss challenger
398
+ gate clean deployment run at 36.00%, the current clean best.
399
  - Jobs `14936131`/`14936132`/`14936133` completed the compatible-chart
400
+ abstention test at margin `0.10`: it reaches 34.67%, below the 36.00% top row.
401
  This rules out a naive lower-margin fix for the apparent oracle headroom.
402
 
403
  Paper table automation: