healed/correctness_ab.log

2026-07-17T04:01:37-07:00 === correctness A/B start ===
2026-07-17T04:01:37-07:00 scoring top-128 -> outputs/teacher_trajectories/dolci_math_nogold_matched_top128 (GPU 0)
2026-07-17T04:21:00-07:00 scoring complete:   "total_records": 9918,
2026-07-17T04:21:00-07:00 healing glean_keep25_nogold_s1224 on GPU 1
2026-07-17T04:21:00-07:00 healing glean_keep25_nogold_s1225 on GPU 2
2026-07-17T04:38:30-07:00 === correctness A/B start ===
2026-07-17T04:38:30-07:00 scoring complete:   "total_records": 9918,
2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1226 on GPU 2
2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1224 on GPU 0
2026-07-17T04:38:30-07:00 healing glean_keep25_nogold_s1225 on GPU 1
2026-07-17T04:41:56-07:00 === correctness A/B start ===
2026-07-17T04:41:56-07:00 scoring complete:   "total_records": 9918,
2026-07-17T04:41:56-07:00 healing glean_keep25_nogold_s1224 on GPU 0
2026-07-17T04:41:56-07:00 healing glean_keep25_nogold_s1225 on GPU 1
2026-07-17T05:33:14-07:00 eval glean_keep25_nogold_s1224
2026-07-17T05:35:05-07:00 eval glean_keep25_nogold_s1225
2026-07-17T05:35:37-07:00 glean_keep25_nogold_s1224 done -> 0.41091736163760423
2026-07-17T05:35:37-07:00 healing glean_keep25_nogold_s1226 on GPU 0
2026-07-17T05:37:25-07:00 glean_keep25_nogold_s1225 done -> 0.4116755117513268
2026-07-17T05:37:25-07:00 lane GPU1 done
2026-07-17T06:28:01-07:00 eval glean_keep25_nogold_s1226
2026-07-17T06:30:25-07:00 glean_keep25_nogold_s1226 done -> 0.42532221379833207
2026-07-17T06:30:25-07:00 lane GPU0 done
2026-07-17T06:30:25-07:00 === correctness A/B COMPLETE ===
seed | curated(correct) | nogold(unfiltered) | delta
1224 |  0.4131918119787718  |  0.41091736163760423  |  -0.2
1225 |  0.4245640636846095  |  0.4116755117513268  |  -1.3
1226 |  0.422289613343442  |  0.42532221379833207  |  +0.3

MEAN curated=0.4200  nogold=0.4160  delta=-0.40 pts
Verdict: |delta| small -> correctness barely matters (general column can skip gold-curation).