ckp_sweep_analysis / candidate_recommendation.md
zhui711's picture
Upload folder using huggingface_hub
29aa7c3 verified
|
Raw
History Blame Contribute Delete
2.31 kB

Candidate Recommendation

  • best_by_lpips: scratch 27500 (step 27500, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0027500)
  • best_by_ssim: scratch 22000 (step 22000, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0022000)
  • best_by_reference_score: scratch 30500 (step 30500, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500)

Top 5 Per Run

merge

  • step 30500: 30500 reference=6.100, LPIPS=0.1531610186092165, SSIM=0.7043568192385189, Dice=0.751570739073081
  • step 28000: 28000 reference=6.900, LPIPS=0.1540439303562398, SSIM=0.7044179239682331, Dice=0.7496276129790961
  • step 18000: 18000 reference=7.700, LPIPS=0.1542735679618445, SSIM=0.7050545590290372, Dice=0.7440291190202412
  • step 27500: 27500 reference=8.800, LPIPS=0.1536342467484577, SSIM=0.7042829202183042, Dice=0.753074830857936
  • step 19500: 19500 reference=10.800, LPIPS=0.1545194888029563, SSIM=0.7042424672847641, Dice=0.7457718447474667

scratch

  • step 30500: 30500 reference=3.400, LPIPS=0.1516165391082569, SSIM=0.7079083551853295, Dice=0.754530190133775
  • step 22000: 22000 reference=4.600, LPIPS=0.1515352333878931, SSIM=0.708311391663021, Dice=0.7540357897754119
  • step 27500: 27500 reference=4.800, LPIPS=0.1510633723838273, SSIM=0.706855824401713, Dice=0.7532641054440187
  • step 23000: 23000 reference=5.400, LPIPS=0.1516584727437539, SSIM=0.7076118645075817, Dice=0.7531120844616478
  • step 31500: 31500 reference=7.800, LPIPS=0.1519705919015176, SSIM=0.7071853844697897, Dice=0.7551106655946678

Scratch vs Merge

  • scratch_best: scratch 30500 (step 30500, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500)
  • merge_best: merge 30500 (step 30500, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/merge/ckpt_0030500)
  • lower reference score winner: scratch 30500 (step 30500, output /apdcephfs_zwfy2/share_303944931/connorxian/Code/medUni/wt/zr/gen_joint/outputs_ckp_sweep/scratch/ckpt_0030500)

Final checkpoint selection should include human visual inspection of generated images and masks.