| 2026-07-17T04:01:37-07:00 === correctness A/B start === |
| 2026-07-17T04:01:37-07:00 scoring top-128 -> outputs/teacher_trajectories/dolci_math_nogold_matched_top128 (GPU 0) |
| 2026-07-17T04:21:00-07:00 scoring complete: "total_records": 9918, |
| 2026-07-17T04:21:00-07:00 healing glean_keep25_nogold_s1224 on GPU 1 |
| 2026-07-17T04:21:00-07:00 healing glean_keep25_nogold_s1225 on GPU 2 |
| 2026-07-17T04:38:30-07:00 === correctness A/B start === |
| 2026-07-17T04:38:30-07:00 scoring complete: "total_records": 9918, |
| 2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1226 on GPU 2 |
| 2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1224 on GPU 0 |
| 2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1225 on GPU 1 |
| 2026-07-17T04:41:56-07:00 === correctness A/B start === |
| 2026-07-17T04:41:56-07:00 scoring complete: "total_records": 9918, |
| 2026-07-17T04:41:56-07:00 healing glean_keep25_nogold_s1224 on GPU 0 |
| 2026-07-17T04:41:56-07:00 healing glean_keep25_nogold_s1225 on GPU 1 |
| 2026-07-17T05:33:14-07:00 eval glean_keep25_nogold_s1224 |
| 2026-07-17T05:35:05-07:00 eval glean_keep25_nogold_s1225 |
| 2026-07-17T05:35:37-07:00 glean_keep25_nogold_s1224 done -> 0.41091736163760423 |
| 2026-07-17T05:35:37-07:00 healing glean_keep25_nogold_s1226 on GPU 0 |
| 2026-07-17T05:37:25-07:00 glean_keep25_nogold_s1225 done -> 0.4116755117513268 |
| 2026-07-17T05:37:25-07:00 lane GPU1 done |
| 2026-07-17T06:28:01-07:00 eval glean_keep25_nogold_s1226 |
| 2026-07-17T06:30:25-07:00 glean_keep25_nogold_s1226 done -> 0.42532221379833207 |
| 2026-07-17T06:30:25-07:00 lane GPU0 done |
| 2026-07-17T06:30:25-07:00 === correctness A/B COMPLETE === |
| seed | curated(correct) | nogold(unfiltered) | delta |
| 1224 | 0.4131918119787718 | 0.41091736163760423 | -0.2 |
| 1225 | 0.4245640636846095 | 0.4116755117513268 | -1.3 |
| 1226 | 0.422289613343442 | 0.42532221379833207 | +0.3 |
|
|
| MEAN curated=0.4200 nogold=0.4160 delta=-0.40 pts |
| Verdict: |delta| small -> correctness barely matters (general column can skip gold-curation). |
|
|
