pino-source-code / results /pimt_v8_multiseed.md
Matthew Ford
pimt v8 multiseed robustness results
a22ee12
|
Raw
History Blame Contribute Delete
2.19 kB
# PIMT v8 multi-seed scaffold robustness sweep
Gate: **pass**.
## Pre-declared summary
- Delta R2: mean 0.128152, across-split 2.5/97.5 percentile range [-0.028630, 0.287823], structure wins 19/20 (0.950).
- Delta rho: mean 0.123687, across-split 2.5/97.5 percentile range [-0.116274, 0.464997], structure wins 16/20 (0.800).
## Per-seed table
| Seed | n_test | rho_struct | rho_base | R2_struct | R2_base | Delta R2 | Delta rho |
| ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| 20260710 | 34 | 0.663380 | 0.613089 | 0.399023 | 0.240577 | 0.158446 | 0.050291 |
| 20260711 | 34 | 0.316000 | 0.337426 | 0.184261 | 0.075317 | 0.108944 | -0.021426 |
| 20260712 | 34 | 0.366470 | 0.311676 | 0.107048 | 0.034749 | 0.072299 | 0.054794 |
| 20260713 | 34 | 0.041101 | 0.228927 | -0.069957 | 0.009372 | -0.079329 | -0.187826 |
| 20260714 | 34 | 0.472551 | 0.314897 | 0.152332 | -0.025625 | 0.177957 | 0.157654 |
| 20260715 | 34 | 0.517790 | -0.054582 | 0.217294 | -0.147816 | 0.365111 | 0.572372 |
| 20260716 | 34 | 0.281819 | 0.021809 | -0.154745 | -0.314102 | 0.159357 | 0.260010 |
| 20260717 | 34 | 0.324532 | 0.293043 | 0.079663 | -0.108612 | 0.188274 | 0.031489 |
| 20260718 | 34 | 0.246655 | 0.200140 | 0.073349 | 0.009226 | 0.064123 | 0.046515 |
| 20260719 | 34 | 0.516702 | 0.293684 | 0.229697 | 0.113003 | 0.116694 | 0.223018 |
| 20260720 | 34 | 0.370805 | 0.215172 | 0.161108 | -0.000470 | 0.161577 | 0.155633 |
| 20260721 | 34 | 0.317233 | 0.305952 | 0.262037 | 0.128102 | 0.133935 | 0.011281 |
| 20260722 | 34 | 0.519090 | 0.409649 | 0.299199 | 0.159745 | 0.139454 | 0.109441 |
| 20260723 | 34 | 0.343971 | 0.364432 | 0.265420 | 0.227927 | 0.037492 | -0.020461 |
| 20260724 | 34 | 0.359630 | 0.255395 | 0.106452 | 0.079046 | 0.027407 | 0.104236 |
| 20260725 | 34 | 0.414285 | 0.225680 | 0.180879 | -0.001996 | 0.182875 | 0.188604 |
| 20260726 | 34 | 0.603517 | 0.257198 | 0.246355 | 0.043956 | 0.202399 | 0.346319 |
| 20260727 | 34 | 0.476494 | 0.513683 | 0.303413 | 0.249948 | 0.053466 | -0.037190 |
| 20260728 | 34 | 0.392965 | 0.209713 | 0.221978 | 0.057282 | 0.164696 | 0.183251 |
| 20260729 | 34 | 0.549418 | 0.303675 | 0.304804 | 0.176935 | 0.127869 | 0.245743 |