Expose four anchored success-conditioning claims
Browse files- logbook.json +9 -9
- pages/executive-summary/page.md +28 -0
- pages/executive-summary/poster_embed.html +1 -0
- pages/index.md +2 -2
- pages/success-cond-repro/page.md +0 -10
logbook.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"schema_version": 1,
|
| 3 |
-
"title": "
|
| 4 |
"emoji": "🎯",
|
| 5 |
"space_id": "SabaPivot/repro-success-conditioning",
|
| 6 |
"paper": {
|
|
@@ -13,9 +13,15 @@
|
|
| 13 |
"updated_at": "2026-07-16T06:29:41+00:00",
|
| 14 |
"root": {
|
| 15 |
"slug": "index",
|
| 16 |
-
"title": "
|
| 17 |
"file": "pages/index.md",
|
| 18 |
"children": [
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
{
|
| 20 |
"slug": "claim-1-chi-squared-trust-region-equivalence-prop-4-1",
|
| 21 |
"title": "Claim 1: Chi-squared trust-region equivalence (Prop 4.1)",
|
|
@@ -45,15 +51,9 @@
|
|
| 45 |
"title": "Conclusion",
|
| 46 |
"file": "pages/conclusion/page.md",
|
| 47 |
"children": []
|
| 48 |
-
},
|
| 49 |
-
{
|
| 50 |
-
"slug": "success-cond-repro",
|
| 51 |
-
"title": "success-cond-repro",
|
| 52 |
-
"file": "pages/success-cond-repro/page.md",
|
| 53 |
-
"children": []
|
| 54 |
}
|
| 55 |
]
|
| 56 |
},
|
| 57 |
"agent_view_tokens": 3916,
|
| 58 |
"revision": "1784183381320786226"
|
| 59 |
-
}
|
|
|
|
| 1 |
{
|
| 2 |
"schema_version": 1,
|
| 3 |
+
"title": "Reproduction: Success-Conditioning as Policy Improvement: The Optimization Problem Solved by Imitating Success",
|
| 4 |
"emoji": "🎯",
|
| 5 |
"space_id": "SabaPivot/repro-success-conditioning",
|
| 6 |
"paper": {
|
|
|
|
| 13 |
"updated_at": "2026-07-16T06:29:41+00:00",
|
| 14 |
"root": {
|
| 15 |
"slug": "index",
|
| 16 |
+
"title": "Reproduction: Success-Conditioning as Policy Improvement: The Optimization Problem Solved by Imitating Success",
|
| 17 |
"file": "pages/index.md",
|
| 18 |
"children": [
|
| 19 |
+
{
|
| 20 |
+
"slug": "executive-summary",
|
| 21 |
+
"title": "Executive summary",
|
| 22 |
+
"file": "pages/executive-summary/page.md",
|
| 23 |
+
"children": []
|
| 24 |
+
},
|
| 25 |
{
|
| 26 |
"slug": "claim-1-chi-squared-trust-region-equivalence-prop-4-1",
|
| 27 |
"title": "Claim 1: Chi-squared trust-region equivalence (Prop 4.1)",
|
|
|
|
| 51 |
"title": "Conclusion",
|
| 52 |
"file": "pages/conclusion/page.md",
|
| 53 |
"children": []
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
}
|
| 55 |
]
|
| 56 |
},
|
| 57 |
"agent_view_tokens": 3916,
|
| 58 |
"revision": "1784183381320786226"
|
| 59 |
+
}
|
pages/executive-summary/page.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Executive summary
|
| 2 |
+
|
| 3 |
+
---
|
| 4 |
+
<!-- trackio-cell
|
| 5 |
+
{"type":"markdown","id":"success_exec_v2","created_at":"2026-07-22T04:15:00+00:00","title":"Executive summary","pinned":true,"pinned_at":"2026-07-22T04:15:00+00:00"}
|
| 6 |
+
-->
|
| 7 |
+
All four supplied claims for [Success-Conditioning as Policy Improvement](https://openreview.net/forum?id=FEmXFeqYNZ) were independently verified on an exact float64 tabular-MDP harness. Across 20 finite-horizon MDPs, the success-conditioned policy solves the chi-squared trust-region problem, with the constraint identity accurate to 2.8e-17. The statewise relative-advantage, chi-squared-movement, and action-influence equality holds to 4.4e-16, while a roughly 200,000-trajectory conditional estimator converges to the same aggregate. The conservative-improvement identity holds to 2.4e-16. Finally, Proposition 7.1 holds to 1.8e-15 on the paper's 100-arm Beta-bandit construction; the thresholded proxy first improves on faithful conditioning, then becomes negatively aligned at high thresholds.
|
| 8 |
+
|
| 9 |
+
## Scope & cost
|
| 10 |
+
|
| 11 |
+
| Item | This reproduction | Full paper evidence |
|
| 12 |
+
| --- | --- | --- |
|
| 13 |
+
| Scope | All 4 supplied claims; exact identities, optimization certificate, conservative improvement, threshold sweep | Same theoretical and analytic-bandit scope |
|
| 14 |
+
| Scale | 20 seeded MDPs; 1,000 feasible-policy comparisons per MDP; about 200,000 trajectories; 100-arm bandit | No larger official experimental suite was released |
|
| 15 |
+
| Hardware | CPU | CPU |
|
| 16 |
+
| Compute/cost | About 5 minutes; $0 | Comparable |
|
| 17 |
+
| Limitation | Numerical verification is not a formal proof | Formal propositions remain in the paper |
|
| 18 |
+
|
| 19 |
+
Artifacts: [reproduction bundle](https://huggingface.co/buckets/SabaPivot/repro-success-conditioning-artifacts#success-cond-repro/repro-bundle:v0) and [artifact Bucket](https://huggingface.co/buckets/SabaPivot/repro-success-conditioning-artifacts).
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
<!-- trackio-cell
|
| 23 |
+
{"type":"figure","id":"success_poster_v2","created_at":"2026-07-22T04:15:00+00:00","title":"Reproduction poster (poster_embed.html)","source_path":"poster_embed.html","pinned":true,"pinned_at":"2026-07-22T04:15:00+00:00"}
|
| 24 |
+
-->
|
| 25 |
+
````html
|
| 26 |
+
<!-- poster_embed.html -->
|
| 27 |
+
<iframe src="https://chenruishuo-posterly.hf.space" title="Posterly reproduction poster" style="width:100%;height:720px;border:0" loading="lazy"></iframe>
|
| 28 |
+
````
|
pages/executive-summary/poster_embed.html
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
<iframe src="https://chenruishuo-posterly.hf.space" title="Posterly reproduction poster" style="width:100%;height:720px;border:0" loading="lazy"></iframe>
|
pages/index.md
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
-
#
|
| 2 |
|
| 3 |
## Pages
|
| 4 |
|
| 5 |
| Page |
|
| 6 |
| --- |
|
|
|
|
| 7 |
| [Claim 1: Chi-squared trust-region equivalence (Prop 4.1)](#/claim-1-chi-squared-trust-region-equivalence-prop-4-1) |
|
| 8 |
| [Claim 2: Three-way equality at every state (Prop 4.3-4.4)](#/claim-2-three-way-equality-at-every-state-prop-4-3-4-4) |
|
| 9 |
| [Claim 3: Conservative improvement operator (Cor 4.5)](#/claim-3-conservative-improvement-operator-cor-4-5) |
|
| 10 |
| [Claim 4: Return thresholding misalignment (Prop 7.1)](#/claim-4-return-thresholding-misalignment-prop-7-1) |
|
| 11 |
| [Conclusion](#/conclusion) |
|
| 12 |
-
| [success-cond-repro](#/success-cond-repro) |
|
|
|
|
| 1 |
+
# Reproduction: Success-Conditioning as Policy Improvement: The Optimization Problem Solved by Imitating Success
|
| 2 |
|
| 3 |
## Pages
|
| 4 |
|
| 5 |
| Page |
|
| 6 |
| --- |
|
| 7 |
+
| [Executive summary](#/executive-summary) |
|
| 8 |
| [Claim 1: Chi-squared trust-region equivalence (Prop 4.1)](#/claim-1-chi-squared-trust-region-equivalence-prop-4-1) |
|
| 9 |
| [Claim 2: Three-way equality at every state (Prop 4.3-4.4)](#/claim-2-three-way-equality-at-every-state-prop-4-3-4-4) |
|
| 10 |
| [Claim 3: Conservative improvement operator (Cor 4.5)](#/claim-3-conservative-improvement-operator-cor-4-5) |
|
| 11 |
| [Claim 4: Return thresholding misalignment (Prop 7.1)](#/claim-4-return-thresholding-misalignment-prop-7-1) |
|
| 12 |
| [Conclusion](#/conclusion) |
|
|
|
pages/success-cond-repro/page.md
DELETED
|
@@ -1,10 +0,0 @@
|
|
| 1 |
-
# success-cond-repro
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
---
|
| 5 |
-
<!-- trackio-cell
|
| 6 |
-
{"type": "artifact", "id": "cell_dd2575f5869a", "created_at": "2026-07-16T06:29:31+00:00", "title": "Artifact: success-cond-repro/repro-bundle:v0", "artifact": "success-cond-repro/repro-bundle:v0", "artifact_type": "dataset"}
|
| 7 |
-
-->
|
| 8 |
-
**📦 Artifact** `success-cond-repro/repro-bundle:v0` · dataset · 3.2 MB
|
| 9 |
-
|
| 10 |
-
https://huggingface.co/buckets/SabaPivot/repro-success-conditioning-artifacts#success-cond-repro/repro-bundle:v0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|