harvardairobotics/ChordEdit-Reproduction / performance_comparison_ablation_merged_summary.md
harvardairobotics's picture
|
download
raw
1.46 kB

ChordEdit ablation notes

Rows: 25

Best values

  • Structure Dist. (min): chord default sd tstart0.6 tend0.3 delta0.0 no cleanup = 0.0112
  • PSNR (max): chord default sd tstart0.6 tend0.3 delta0.0 no cleanup = 27.1179
  • LPIPS (min): chord default sd tstart0.6 tend0.3 delta0.0 no cleanup = 0.0526
  • MSE (min): chord default sd tstart0.6 tend0.3 delta0.0 no cleanup = 0.0034
  • SSIM (max): chord default sd tstart0.6 tend0.3 delta0.0 no cleanup = 0.8509
  • CLIP Src. (max): chord default sd tstart0.6 tend0.3 delta0.0 cleanup = 25.4281
  • CLIP Tgt. (max): chord default sd tstart0.9 tend0.5 delta0.15 cleanup = 25.5356
  • CLIP-Edited (max): chord default sd tstart0.9 tend0.5 delta0.15 cleanup = 22.9703

Default reference

chord default sd tstart0.9 tend0.3 delta0.15 cleanup

  • Structure Dist.: 0.0295
  • PSNR: 22.6430
  • LPIPS: 0.1185
  • SSIM: 0.7675
  • CLIP-Edited: 22.1554

Reading the ablation

  • Lower t_start preserves the unedited region better but weakens the edit: tstart0.6 changes PSNR by +2.2401 and CLIP-Edited by -1.0514 versus default.
  • Higher t_end pushes edit strength at the cost of preservation: tend0.5 changes CLIP-Edited by +0.8149 and PSNR by -2.2032 versus default.
  • delta0.25 is the best single-parameter preservation point among the delta sweep, with PSNR 23.7389 and CLIP-Edited 21.8370.
  • The delta0.0, t_start=0.6, no cleanup run is the preservation extreme, but it gives up 1.7732 CLIP-Edited points versus default.

Xet Storage Details

Size:
1.46 kB
·
Xet hash:
c9617d0cc353e71f0cc650bb8313583ee7608aa086a432302ed035e34351f4b6

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.