Add decision-aware compression and frozen-model diagnostics
Browse files- README.md +5 -0
- SHA256SUMS.json +11 -2
README.md
CHANGED
|
@@ -28,6 +28,7 @@ python reproduce.py --mode check --output checksum_report.json
|
|
| 28 |
python reproduce.py --mode all --device cuda:0 --output replay_report.json
|
| 29 |
python analyze.py --device cuda:0 --output statistics.json
|
| 30 |
python paper/build_figures.py
|
|
|
|
| 31 |
```
|
| 32 |
|
| 33 |
Replay checks all 132 checkpoints, the controlled primary comparison and the four-day sign-flip result. Analysis recomputes paired uncertainty from the supplied reference scores. Figure generation writes all article figures and tables under paper/.
|
|
@@ -55,6 +56,10 @@ Raw-source reconstruction downloads the official archives and verifies their dig
|
|
| 55 |
|
| 56 |
The controlled compression gain is 0.1013 utility. The external compression improvement criterion fails. The four-day temporal comparison is secondary because one source day fails its clock check; exact one-sided day-level p=0.0625. The 128-label hydraulic reversal, calibration failure and lack of complete-cost superiority are retained. These artifacts do not establish operational root-cause reliability.
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
## Data and license
|
| 59 |
|
| 60 |
Code is MIT; original models, generated data and research outputs are CC BY 4.0. Hydraulic features derive from Helwig, Pignanelli and Schuetze (UCI DOI 10.24432/C5CW21); temperature-modulated sensor features derive from Burgues (10.24432/C5S302). Gas-drift recordings (Vergara, 10.24432/C5RP6W) are retrieved separately and are not redistributed; preserve the source's legacy research-only notice. Full attribution and terms are in LICENSE.md.
|
|
|
|
| 28 |
python reproduce.py --mode all --device cuda:0 --output replay_report.json
|
| 29 |
python analyze.py --device cuda:0 --output statistics.json
|
| 30 |
python paper/build_figures.py
|
| 31 |
+
python postconfirmation.py --device cuda:0 --output postconfirmation_replay
|
| 32 |
```
|
| 33 |
|
| 34 |
Replay checks all 132 checkpoints, the controlled primary comparison and the four-day sign-flip result. Analysis recomputes paired uncertainty from the supplied reference scores. Figure generation writes all article figures and tables under paper/.
|
|
|
|
| 56 |
|
| 57 |
The controlled compression gain is 0.1013 utility. The external compression improvement criterion fails. The four-day temporal comparison is secondary because one source day fails its clock check; exact one-sided day-level p=0.0625. The 128-label hydraulic reversal, calibration failure and lack of complete-cost superiority are retained. These artifacts do not establish operational root-cause reliability.
|
| 58 |
|
| 59 |
+
## Additional analysis on opened data
|
| 60 |
+
|
| 61 |
+
An action-value compression control, a complete 1,212-episode partition and normalization checks for all 132 checkpoints, and crossed frozen hydraulic means/covariances are in results/postconfirmation/. The single added encoder was specified after the original confirmation was opened. Its specification and code hash are in protocols/postconfirmation_analysis_01.json. Original protocols, promotion decisions and checkpoints are unchanged. The command above recomputes the complete analysis without refitting. Measured timings are hardware-dependent.
|
| 62 |
+
|
| 63 |
## Data and license
|
| 64 |
|
| 65 |
Code is MIT; original models, generated data and research outputs are CC BY 4.0. Hydraulic features derive from Helwig, Pignanelli and Schuetze (UCI DOI 10.24432/C5CW21); temperature-modulated sensor features derive from Burgues (10.24432/C5S302). Gas-drift recordings (Vergara, 10.24432/C5RP6W) are retrieved separately and are not redistributed; preserve the source's legacy research-only notice. Full attribution and terms are in LICENSE.md.
|
SHA256SUMS.json
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
".gitattributes": "0aad2046ff3535fdb3750ad77100b4f6aed80009c097ffc8a9e264a5d1b0c4e7",
|
| 3 |
"ENVIRONMENT.json": "786e73bb84b1300d1b5062961af74aacbab2bbfe1e12675ba6ceebd12d26b0eb",
|
| 4 |
"LICENSE.md": "4a8b21f5c8ee1383fdf12d8622df51066334d446513d7318ab8a31763f435813",
|
| 5 |
-
"README.md": "
|
| 6 |
"analyze.py": "3e2ee19da7cdec5b735db55a368132977d8aa6cfe4cfd8e49dbe86019a56a444",
|
| 7 |
"data/controlled/manifest.json": "2b50155e7f4d198449e2499dad21ba82d51e94423a1711eca8de4a01ab9ca156",
|
| 8 |
"data/controlled/worlds.json": "860e154c4ffd0690080ab8c263756d4340cc119fffa66e1cc41d1b42ac3848cb",
|
|
@@ -276,12 +276,14 @@
|
|
| 276 |
"models/temperature/n64_s20853/joint_gaussian.safetensors": "61a2a8634c41b022d1592c023619ba2eaca9c479b10084336f96e81e24082336",
|
| 277 |
"models/temperature/n64_s20853/joint_neural.json": "e12f0d7d3afdfaca38166039e9511b5c7ad4528f0d90138bf99a2255730d8aff",
|
| 278 |
"models/temperature/n64_s20853/joint_neural.safetensors": "b7f1d2465706477e65bdd03115813abd8504589d3cbe749ebcd7c4188c363ae1",
|
| 279 |
-
"paper/build_figures.py": "
|
| 280 |
"paper/sensitivity_analysis.py": "22128d4180683b5cc57da7ffaf9a37f2ffcef0354afd4b725c055f1307baebc1",
|
|
|
|
| 281 |
"protocols/day_transfer_protocol_01.json": "a8a46886819f182a89e3ba00bb0cdc0be8b28d5988ce5a6bd8c7f3281e5a2f9b",
|
| 282 |
"protocols/decision_sufficiency_protocol_01.json": "5a334fe26903403ff48eb71e7b0eb548d139af50c97b430252db0cf71b2c1f59",
|
| 283 |
"protocols/external_sufficiency_protocol_01.json": "e0229ef8a50270b7a590c6ed79a850ec8f902d17f2c8213111bf432669ef9d04",
|
| 284 |
"protocols/factorial_transfer_protocol_01.json": "aadd4b386cd447cdf8e4fbb19f8925b2a73ee86006dc5ab45e298d4a864c7d7c",
|
|
|
|
| 285 |
"provenance/controlled/compute_ledger.json": "d9bdae8b500e832f0ff2c0650a345cbd9c10545e631ff18aa1750582e5b1af07",
|
| 286 |
"provenance/controlled/confirmation_benchmark.json": "133420e45f42ff5dbacc8d01700aeba56bf65c02f5bc0b30bb7aff45a88bc249",
|
| 287 |
"provenance/controlled/preconfirmation_lock.json": "c85bbf9f9aa482a49a3ab6d375e9930ee4e4fbda80d6ac6dacd3d43446f2ec4c",
|
|
@@ -318,6 +320,13 @@
|
|
| 318 |
"results/external/paired_comparisons.json": "f2a368a09611e047f94312ebed8e82e8669e12c0c228162f6fe6903e3fd06cb8",
|
| 319 |
"results/hydraulic/predictions.json": "190d3f225d309a98d6b00abc1d3b4e2f11c63706aaa94b585476cc2484b9f25b",
|
| 320 |
"results/hydraulic/predictions.safetensors": "2409700b0e6bbde39954f423dae9198c017a53066797801a62d421b5f6f404a8",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 321 |
"results/sensitivity_analysis/frozen_diagnostics.json": "434dd65be1ab604360f5d7fdf03ef18ab1ef13e8fcd00245620e6574d4f57a37",
|
| 322 |
"results/temperature/predictions.json": "39bd384897cd9e4a6cefb65d06cde29aec83023cb7eb42515cfd34900ab07c97",
|
| 323 |
"results/temperature/predictions.safetensors": "1760854a676b82df524bfa9e4eb1b539b1a2754e05e92e5d0e8229719958f8f3",
|
|
|
|
| 2 |
".gitattributes": "0aad2046ff3535fdb3750ad77100b4f6aed80009c097ffc8a9e264a5d1b0c4e7",
|
| 3 |
"ENVIRONMENT.json": "786e73bb84b1300d1b5062961af74aacbab2bbfe1e12675ba6ceebd12d26b0eb",
|
| 4 |
"LICENSE.md": "4a8b21f5c8ee1383fdf12d8622df51066334d446513d7318ab8a31763f435813",
|
| 5 |
+
"README.md": "f6be7fca2e03477cf296dfc2c4633d934a32eac491e838ef1b7f46cef2a4ec75",
|
| 6 |
"analyze.py": "3e2ee19da7cdec5b735db55a368132977d8aa6cfe4cfd8e49dbe86019a56a444",
|
| 7 |
"data/controlled/manifest.json": "2b50155e7f4d198449e2499dad21ba82d51e94423a1711eca8de4a01ab9ca156",
|
| 8 |
"data/controlled/worlds.json": "860e154c4ffd0690080ab8c263756d4340cc119fffa66e1cc41d1b42ac3848cb",
|
|
|
|
| 276 |
"models/temperature/n64_s20853/joint_gaussian.safetensors": "61a2a8634c41b022d1592c023619ba2eaca9c479b10084336f96e81e24082336",
|
| 277 |
"models/temperature/n64_s20853/joint_neural.json": "e12f0d7d3afdfaca38166039e9511b5c7ad4528f0d90138bf99a2255730d8aff",
|
| 278 |
"models/temperature/n64_s20853/joint_neural.safetensors": "b7f1d2465706477e65bdd03115813abd8504589d3cbe749ebcd7c4188c363ae1",
|
| 279 |
+
"paper/build_figures.py": "5833c7d5f9a069e4a5a5494c393d828b805166bd367134c01f6304528ebfe1c2",
|
| 280 |
"paper/sensitivity_analysis.py": "22128d4180683b5cc57da7ffaf9a37f2ffcef0354afd4b725c055f1307baebc1",
|
| 281 |
+
"postconfirmation.py": "3365341c056cee9b153cc864bad864965c918e11e0cec1819d49c8875c68dcbf",
|
| 282 |
"protocols/day_transfer_protocol_01.json": "a8a46886819f182a89e3ba00bb0cdc0be8b28d5988ce5a6bd8c7f3281e5a2f9b",
|
| 283 |
"protocols/decision_sufficiency_protocol_01.json": "5a334fe26903403ff48eb71e7b0eb548d139af50c97b430252db0cf71b2c1f59",
|
| 284 |
"protocols/external_sufficiency_protocol_01.json": "e0229ef8a50270b7a590c6ed79a850ec8f902d17f2c8213111bf432669ef9d04",
|
| 285 |
"protocols/factorial_transfer_protocol_01.json": "aadd4b386cd447cdf8e4fbb19f8925b2a73ee86006dc5ab45e298d4a864c7d7c",
|
| 286 |
+
"protocols/postconfirmation_analysis_01.json": "9e0dc34ce91fc91d577975cadbc7ba11d330ff2dc22d630193e95a73a2095d58",
|
| 287 |
"provenance/controlled/compute_ledger.json": "d9bdae8b500e832f0ff2c0650a345cbd9c10545e631ff18aa1750582e5b1af07",
|
| 288 |
"provenance/controlled/confirmation_benchmark.json": "133420e45f42ff5dbacc8d01700aeba56bf65c02f5bc0b30bb7aff45a88bc249",
|
| 289 |
"provenance/controlled/preconfirmation_lock.json": "c85bbf9f9aa482a49a3ab6d375e9930ee4e4fbda80d6ac6dacd3d43446f2ec4c",
|
|
|
|
| 320 |
"results/external/paired_comparisons.json": "f2a368a09611e047f94312ebed8e82e8669e12c0c228162f6fe6903e3fd06cb8",
|
| 321 |
"results/hydraulic/predictions.json": "190d3f225d309a98d6b00abc1d3b4e2f11c63706aaa94b585476cc2484b9f25b",
|
| 322 |
"results/hydraulic/predictions.safetensors": "2409700b0e6bbde39954f423dae9198c017a53066797801a62d421b5f6f404a8",
|
| 323 |
+
"results/postconfirmation/compute.json": "5f78aa7fc4e606ac521f7d30e8931d8d9e6d461c7076bce4712808d3c197d5af",
|
| 324 |
+
"results/postconfirmation/controlled_frontiers.csv.gz": "946ebf8764ee3dfed5a741fa3a45e0cb5f8476960453716d9abebed0aa617e57",
|
| 325 |
+
"results/postconfirmation/controlled_summary.json": "0fc9fac7ff1c2333c8cf29a91deabd8b80c7a85940452bf774de7d20daa9b7f5",
|
| 326 |
+
"results/postconfirmation/controlled_timing.json": "082e8b981d9e6b13a07bfd3136d6afe08681bb8c702ba2c0c2b9a2d4966b6eea",
|
| 327 |
+
"results/postconfirmation/controlled_worlds.csv.gz": "bdb15095eadf96dff2aa316619a838b74024eece87c57143bcd44b4710e9547f",
|
| 328 |
+
"results/postconfirmation/hydraulic_bindings.csv.gz": "1eace573f2943eaf0cd83075803c38907fdf109f3a38ae0e354df66403bc8f10",
|
| 329 |
+
"results/postconfirmation/sensor_diagnostics.json": "00863f0acd7c00c7738ccb6dc116f65b14c02cbca1f8c75a95ed4f17d3c9acb1",
|
| 330 |
"results/sensitivity_analysis/frozen_diagnostics.json": "434dd65be1ab604360f5d7fdf03ef18ab1ef13e8fcd00245620e6574d4f57a37",
|
| 331 |
"results/temperature/predictions.json": "39bd384897cd9e4a6cefb65d06cde29aec83023cb7eb42515cfd34900ab07c97",
|
| 332 |
"results/temperature/predictions.safetensors": "1760854a676b82df524bfa9e4eb1b539b1a2754e05e92e5d0e8229719958f8f3",
|