Auto-sync: 2026-06-30 03:55:26
Browse files- results/README.md +21 -8
results/README.md
CHANGED
|
@@ -68,6 +68,8 @@ Use these summaries for the current paper tables:
|
|
| 68 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
| 69 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_summary.md`,
|
| 70 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
|
|
|
|
|
|
| 71 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_srcscorebonus0p02_summary.md`,
|
| 72 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_srcscorebonus0p02_summary.md`,
|
| 73 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_l2comp002_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
|
@@ -124,24 +126,30 @@ Completed deployment-clean diagnostics:
|
|
| 124 |
|
| 125 |
Completed residual transport jobs:
|
| 126 |
|
| 127 |
-
Last checked: `2026-06-
|
| 128 |
-
sweep
|
| 129 |
`residual_near_miss+residual_no_op` composite is additionally masked. Pure
|
| 130 |
masked composition reached 35.30%, and masked composition with the exact typed
|
| 131 |
no-op prior reached 35.54%. Raw selected candidate types show no random-negative
|
| 132 |
or wrong-direction composite leak. The paper table/paired analysis now use the
|
| 133 |
-
|
| 134 |
priors are negative (35.36%), and a train-source score prior on the exact
|
| 135 |
-
compatibility chart reaches 35.48%, below the 35.59%
|
| 136 |
source-score prior to the typed no-op exact-mask row reaches 35.54%, also below
|
| 137 |
the top row. The mask-only exact compatibility ablation completed at 35.48%,
|
| 138 |
isolating the compatibility mask from typed-prior tuning.
|
| 139 |
The singleton near-miss revival diagnostic completed: exact
|
| 140 |
-
`residual_near_miss` bonuses 0.01 and 0.02 both tie the 35.59%
|
| 141 |
slightly raise mean progress to 57.10%, but do not improve success.
|
| 142 |
Composite-only L2 trust penalties reduce
|
| 143 |
action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
|
| 144 |
`0.05` reaches 35.48%, and exact compatibility + L2 `0.02` reaches 35.54%.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 145 |
|
| 146 |
- Code supports `--retrieval-residual-scale`, defaulting to `1.0` so the
|
| 147 |
completed 32.12% result is unchanged.
|
|
@@ -293,7 +301,8 @@ action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
|
|
| 293 |
- Jobs `14915009`/`14915013`/`14915014` completed the exact compatibility-mask
|
| 294 |
GPU array, summary, and rebuild. Dropping only `near_miss+no_op` raises the
|
| 295 |
clean row to 35.59% with seeds 35.30%/34.78%/36.70%, progress 57.07%, and
|
| 296 |
-
action MSE 0.406. This is the
|
|
|
|
| 297 |
- Job `14915146` completed the CPU smoke for exact compatibility masking plus
|
| 298 |
composite-only L2 trust penalty `0.02`.
|
| 299 |
- Jobs `14915213`/`14915217`/`14915251` completed the exact compatibility + L2
|
|
@@ -382,9 +391,13 @@ action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
|
|
| 382 |
- The evaluator now pads/slices residual horizons to the policy horizon
|
| 383 |
defensively and deduplicates candidate-oracle actions before oracle selection;
|
| 384 |
invalid padding branches cannot win. Jobs `14953513`/`14953522`/`14953524`
|
| 385 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 386 |
- Jobs `14936131`/`14936132`/`14936133` completed the compatible-chart
|
| 387 |
-
abstention test at margin `0.10`: it reaches 34.67%, below the
|
| 388 |
This rules out a naive lower-margin fix for the apparent oracle headroom.
|
| 389 |
|
| 390 |
Paper table automation:
|
|
|
|
| 68 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
| 69 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_summary.md`,
|
| 70 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
| 71 |
+
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_oraclek8trace_summary.md`,
|
| 72 |
+
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_nmchallenger0p02_summary.md`,
|
| 73 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_srcscorebonus0p02_summary.md`,
|
| 74 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_grid035040045_safe_margin0p20_noopbonus0p03_srcscorebonus0p02_summary.md`,
|
| 75 |
`h16_policy_ckpt_near_miss_policy_bc5_bestpt_retrieval_residual_k4_composemasked_dropnmnoop_l2comp002_grid035040045_safe_margin0p20_noopbonus0p03_summary.md`,
|
|
|
|
| 126 |
|
| 127 |
Completed residual transport jobs:
|
| 128 |
|
| 129 |
+
Last checked: `2026-06-30 03:45 UTC`. The K4 masked composed type-consensus
|
| 130 |
+
sweep produced the previous clean best, 35.59%, when the exact
|
| 131 |
`residual_near_miss+residual_no_op` composite is additionally masked. Pure
|
| 132 |
masked composition reached 35.30%, and masked composition with the exact typed
|
| 133 |
no-op prior reached 35.54%. Raw selected candidate types show no random-negative
|
| 134 |
or wrong-direction composite leak. The paper table/paired analysis now use the
|
| 135 |
+
near-miss challenger row as `best_clean_key`. Component-wise composite
|
| 136 |
priors are negative (35.36%), and a train-source score prior on the exact
|
| 137 |
+
compatibility chart reaches 35.48%, below the previous 35.59% compatibility row. Adding the same
|
| 138 |
source-score prior to the typed no-op exact-mask row reaches 35.54%, also below
|
| 139 |
the top row. The mask-only exact compatibility ablation completed at 35.48%,
|
| 140 |
isolating the compatibility mask from typed-prior tuning.
|
| 141 |
The singleton near-miss revival diagnostic completed: exact
|
| 142 |
+
`residual_near_miss` bonuses 0.01 and 0.02 both tie the previous 35.59% compatibility row and
|
| 143 |
slightly raise mean progress to 57.10%, but do not improve success.
|
| 144 |
Composite-only L2 trust penalties reduce
|
| 145 |
action MSE but do not improve success: standalone L2 `0.02` ties 35.54%, L2
|
| 146 |
`0.05` reaches 35.48%, and exact compatibility + L2 `0.02` reaches 35.54%.
|
| 147 |
+
The unique-action K=8 candidate-oracle diagnostic is complete: the archived
|
| 148 |
+
non-unique run remains `_nonunique`, while the deduplicated branch trace reaches
|
| 149 |
+
43.07% candidate-oracle success with mean best branch rank 2.85. The resulting
|
| 150 |
+
trace-motivated near-miss challenger gate (`residual_near_miss`, margin 0.02)
|
| 151 |
+
is deployment-clean and reaches 36.00% mean success with 57.42% progress, the
|
| 152 |
+
current clean best.
|
| 153 |
|
| 154 |
- Code supports `--retrieval-residual-scale`, defaulting to `1.0` so the
|
| 155 |
completed 32.12% result is unchanged.
|
|
|
|
| 301 |
- Jobs `14915009`/`14915013`/`14915014` completed the exact compatibility-mask
|
| 302 |
GPU array, summary, and rebuild. Dropping only `near_miss+no_op` raises the
|
| 303 |
clean row to 35.59% with seeds 35.30%/34.78%/36.70%, progress 57.07%, and
|
| 304 |
+
action MSE 0.406. This is the previous best clean deployment diagnostic before
|
| 305 |
+
the near-miss challenger gate.
|
| 306 |
- Job `14915146` completed the CPU smoke for exact compatibility masking plus
|
| 307 |
composite-only L2 trust penalty `0.02`.
|
| 308 |
- Jobs `14915213`/`14915217`/`14915251` completed the exact compatibility + L2
|
|
|
|
| 391 |
- The evaluator now pads/slices residual horizons to the policy horizon
|
| 392 |
defensively and deduplicates candidate-oracle actions before oracle selection;
|
| 393 |
invalid padding branches cannot win. Jobs `14953513`/`14953522`/`14953524`
|
| 394 |
+
completed the unique-action K=8 candidate-oracle diagnostic at 43.07%.
|
| 395 |
+
Jobs `14953960`/`14953961` completed the branch-trace rerun used for selector
|
| 396 |
+
calibration.
|
| 397 |
+
- Jobs `14954280`/`14954281` completed the trace-motivated near-miss challenger
|
| 398 |
+
gate clean deployment run at 36.00%, the current clean best.
|
| 399 |
- Jobs `14936131`/`14936132`/`14936133` completed the compatible-chart
|
| 400 |
+
abstention test at margin `0.10`: it reaches 34.67%, below the 36.00% top row.
|
| 401 |
This rules out a naive lower-margin fix for the apparent oracle headroom.
|
| 402 |
|
| 403 |
Paper table automation:
|