manual-selector-job-sync 2026-07-04T04:36:59Z workspace
Browse files- workspace/README.md +36 -1
workspace/README.md
CHANGED
|
@@ -20,7 +20,10 @@ selector/dominance side remains the bottleneck. The strongest current
|
|
| 20 |
train-clean K=16 selector reaches `selected_success = 0.3542` against a
|
| 21 |
`0.5694` proposal oracle, leaving a `0.2431` success selector gap. The
|
| 22 |
score-source LCB dominance fallback is safe under action-bound labels but
|
| 23 |
-
negative as a selector (`0.2778` auto, `0.2917` tau0).
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
All other Markdown files were removed and consolidated into this README. The
|
| 26 |
canonical paper is `latex/main.tex` plus `latex/main.pdf`; experiment evidence
|
|
@@ -434,6 +437,12 @@ High-value run directories:
|
|
| 434 |
best current train-clean selector diagnostic.
|
| 435 |
- `runs/ctt_base_context_obs_learned_dominance_score_*_envclip_k16_train_to_test`:
|
| 436 |
score-shape selector diagnostics; these did not improve the best selector.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 437 |
- `runs/ctt_base_context_obs_nonlinear_dominance_chartcompat_obs_*`: fixed
|
| 438 |
nonlinear selector diagnostics.
|
| 439 |
- `runs/summary_ctt.csv`: global run summary table.
|
|
@@ -597,6 +606,32 @@ chart-compat selector.
|
|
| 597 |
Interpretation: small deployment-visible selector features are not enough; the
|
| 598 |
paper should keep emphasizing positive tangent support generation and CTT.
|
| 599 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 600 |
### K=16 score-source LCB dominance
|
| 601 |
|
| 602 |
Runs:
|
|
|
|
| 20 |
train-clean K=16 selector reaches `selected_success = 0.3542` against a
|
| 21 |
`0.5694` proposal oracle, leaving a `0.2431` success selector gap. The
|
| 22 |
score-source LCB dominance fallback is safe under action-bound labels but
|
| 23 |
+
negative as a selector (`0.2778` auto, `0.2917` tau0). Additional K=8 tanh
|
| 24 |
+
and per-dimension trainmax selector sweeps completed on 2026-07-04; the best
|
| 25 |
+
tanh selector reaches `0.3819` selected success, but its proposal oracle is
|
| 26 |
+
only `0.3819`, so it does not replace the K=16 `env_clip` outcome gate.
|
| 27 |
|
| 28 |
All other Markdown files were removed and consolidated into this README. The
|
| 29 |
canonical paper is `latex/main.tex` plus `latex/main.pdf`; experiment evidence
|
|
|
|
| 437 |
best current train-clean selector diagnostic.
|
| 438 |
- `runs/ctt_base_context_obs_learned_dominance_score_*_envclip_k16_train_to_test`:
|
| 439 |
score-shape selector diagnostics; these did not improve the best selector.
|
| 440 |
+
- `runs/ctt_base_context_obs_learned_dominance_*_tanh_train_to_test`: K=8
|
| 441 |
+
tanh selector diagnostics from Slurm job `15149814`; best selected success
|
| 442 |
+
is `0.3819`, but proposal oracle is also only `0.3819`.
|
| 443 |
+
- `runs/ctt_base_context_obs_learned_dominance_*_perdim_trainmax_train_to_test`:
|
| 444 |
+
per-dimension trainmax selector diagnostics from Slurm job `15149815`; these
|
| 445 |
+
are below the current K=16 `env_clip` support setting.
|
| 446 |
- `runs/ctt_base_context_obs_nonlinear_dominance_chartcompat_obs_*`: fixed
|
| 447 |
nonlinear selector diagnostics.
|
| 448 |
- `runs/summary_ctt.csv`: global run summary table.
|
|
|
|
| 606 |
Interpretation: small deployment-visible selector features are not enough; the
|
| 607 |
paper should keep emphasizing positive tangent support generation and CTT.
|
| 608 |
|
| 609 |
+
### K=8 tanh and per-dimension trainmax selector diagnostics
|
| 610 |
+
|
| 611 |
+
Jobs:
|
| 612 |
+
|
| 613 |
+
```text
|
| 614 |
+
15149814 scripts/slurm/eval_tanh_train_dominance.sbatch
|
| 615 |
+
15149815 scripts/slurm/eval_perdim_trainmax_dominance.sbatch
|
| 616 |
+
```
|
| 617 |
+
|
| 618 |
+
Both jobs completed with exit code `0:0` on 2026-07-04 and wrote README-only
|
| 619 |
+
artifacts, with no persistent `report.md`. The strongest tanh learned selector
|
| 620 |
+
is `context_success` with selected success `0.3819`, but the tanh proposal
|
| 621 |
+
oracle is also `0.3819`; this is a selector diagnostic, not a stronger CTT
|
| 622 |
+
support result. The best per-dimension trainmax selector reaches `0.3333`
|
| 623 |
+
selected success with proposal oracle `0.2222`, which is worse than the K=16
|
| 624 |
+
`env_clip` support setting.
|
| 625 |
+
|
| 626 |
+
| Diagnostic family | Best run | Selected success | Proposal oracle | Success selector gap |
|
| 627 |
+
| --- | --- | ---: | ---: | ---: |
|
| 628 |
+
| tanh | `context_success` | 0.3819 | 0.3819 | 0.1250 |
|
| 629 |
+
| per-dim trainmax | `context` | 0.3333 | 0.2222 | 0.0625 |
|
| 630 |
+
|
| 631 |
+
Interpretation: these sweeps reinforce the current diagnosis: changing the
|
| 632 |
+
execution/action transform or lightweight selector features does not yet
|
| 633 |
+
produce a deployment-clean method success.
|
| 634 |
+
|
| 635 |
### K=16 score-source LCB dominance
|
| 636 |
|
| 637 |
Runs:
|