ckp_sweep_analysis / candidate_recommendation.md
zhui711's picture
Upload folder using huggingface_hub
29aa7c3 verified
|
Raw
History Blame Contribute Delete
2.31 kB
# Candidate Recommendation
- best_by_lpips: scratch 27500 (step 27500, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0027500`)
- best_by_ssim: scratch 22000 (step 22000, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0022000`)
- best_by_reference_score: scratch 30500 (step 30500, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500`)
## Top 5 Per Run
### merge
- step 30500: 30500 reference=6.100, LPIPS=0.1531610186092165, SSIM=0.7043568192385189, Dice=0.751570739073081
- step 28000: 28000 reference=6.900, LPIPS=0.1540439303562398, SSIM=0.7044179239682331, Dice=0.7496276129790961
- step 18000: 18000 reference=7.700, LPIPS=0.1542735679618445, SSIM=0.7050545590290372, Dice=0.7440291190202412
- step 27500: 27500 reference=8.800, LPIPS=0.1536342467484577, SSIM=0.7042829202183042, Dice=0.753074830857936
- step 19500: 19500 reference=10.800, LPIPS=0.1545194888029563, SSIM=0.7042424672847641, Dice=0.7457718447474667
### scratch
- step 30500: 30500 reference=3.400, LPIPS=0.1516165391082569, SSIM=0.7079083551853295, Dice=0.754530190133775
- step 22000: 22000 reference=4.600, LPIPS=0.1515352333878931, SSIM=0.708311391663021, Dice=0.7540357897754119
- step 27500: 27500 reference=4.800, LPIPS=0.1510633723838273, SSIM=0.706855824401713, Dice=0.7532641054440187
- step 23000: 23000 reference=5.400, LPIPS=0.1516584727437539, SSIM=0.7076118645075817, Dice=0.7531120844616478
- step 31500: 31500 reference=7.800, LPIPS=0.1519705919015176, SSIM=0.7071853844697897, Dice=0.7551106655946678
## Scratch vs Merge
- scratch_best: scratch 30500 (step 30500, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500`)
- merge_best: merge 30500 (step 30500, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/merge/ckpt_0030500`)
- lower reference score winner: scratch 30500 (step 30500, output `/apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500`)
Final checkpoint selection should include human visual inspection of generated images and masks.