ImpactSynth / MR_MODEL_INFO.md
Valentin Boussot
Update whole-body sCT model
b47375f
|
Raw
History Blame Contribute Delete
17.1 kB

ImpactSynth MR

Summary

  • Modality: whole-body MR to sCT synthesis
  • Dataset source: SynthRAD 2023 and SynthRAD 2025 Task 1
  • Distributed checkpoints: CV_0.pt, CV_1.pt, CV_2.pt, CV_3.pt, CV_4.pt
  • Inference-time test-time augmentation: tta = 2
  • Monte Carlo dropout: false
  • Framework: KonfAI
  • Architecture: 2.5D UNet++ with a ResNet34 encoder
  • Main perceptual prior: SAM 2.1-s through the IMPACT-Synth loss
  • Pair alignment: CT-MR pairs are aligned with IMPACTReg
  • Transform files:
    • https://huggingface.co/datasets/VBoussot/synthrad2023-impact-registration
    • https://huggingface.co/datasets/VBoussot/synthrad2025-impact-registration

Data splits

The repository contains the validation and cross-validation splits used for Task 1.

  • Patients in the 2023 Task 1 training cohort: 317

  • Patients in the 2025 Task 1 training cohort: 410

  • Total patients across the paired 2023+2025 Task 1 cohorts: 727

  • Additional out-of-distribution Task 1 patients: 78

  • Region counts in the paired 2023+2025 Task 1 cohorts:

    • AB: 138
    • HN: 129
    • TH: 143
    • brain: 172
    • pelvis: 145
  • OOD cohort counts:

    • CSIRO: 24
    • GA: 17
    • MR_Linac: 25
    • MR_Rennes: 12
  • Validation.txt: 140 patients

  • CrossValidation_0..4.txt are validation folds associated with the distributed checkpoints

  • Validation.txt: 140 patients

  • CrossValidation_0.txt: 126 validation patients

  • CrossValidation_1.txt: 125 validation patients

  • CrossValidation_2.txt: 123 validation patients

  • CrossValidation_3.txt: 121 validation patients

  • CrossValidation_4.txt: 117 validation patients

Release CV performance

Overall Release CV metrics:

  • Dice is reported with TS = 3 mm on the CT body mask.

  • All detailed metrics are reported in the tables below.

  • Dice: 0.698 +/- 0.106

  • MAE: 67.49 +/- 15.97 HU

  • SSIM: 0.959 +/- 0.056

  • PSNR: 29.28 +/- 2.10 dB

  • SAM: 21.98 +/- 7.69

  • Reg: 0.622 +/- 0.303

  • Uncertainty: 1822.49 +/- 1035.84

Per-fold overall Release metrics:

Fold n Dice MAE (HU) SSIM PSNR (dB) SAM Reg Uncertainty
CV 140 0.698 +/- 0.106 67.49 +/- 15.97 0.959 +/- 0.056 29.28 +/- 2.10 21.98 +/- 7.69 0.622 +/- 0.303 1822.49 +/- 1035.84
CV_0 140 0.682 +/- 0.112 76.04 +/- 18.29 0.956 +/- 0.060 28.28 +/- 1.99 20.69 +/- 6.65 0.632 +/- 0.303 n/a
CV_1 140 0.688 +/- 0.110 75.40 +/- 17.93 0.957 +/- 0.059 28.37 +/- 2.00 20.73 +/- 6.81 0.628 +/- 0.297 n/a
CV_2 140 0.696 +/- 0.108 70.98 +/- 15.90 0.958 +/- 0.057 28.69 +/- 1.99 20.29 +/- 7.17 0.634 +/- 0.302 n/a
CV_3 140 0.695 +/- 0.110 71.23 +/- 16.07 0.959 +/- 0.056 28.67 +/- 1.99 20.12 +/- 6.97 0.633 +/- 0.300 n/a
CV_4 140 0.696 +/- 0.106 71.53 +/- 16.25 0.957 +/- 0.057 28.64 +/- 2.04 20.22 +/- 7.13 0.634 +/- 0.305 n/a

Regional Release CV metrics:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg Uncertainty
AB 22 0.598 60.10 0.975 30.01 27.41 0.511 1543.81
HN 21 0.645 80.89 0.949 28.44 13.41 0.435 1308.83
TH 23 0.645 58.45 1.000 31.21 21.64 0.466 751.61
brain 27 0.751 79.71 0.973 27.44 13.21 1.199 3402.08
pelvis 23 0.756 48.16 0.940 31.28 25.95 0.574 2348.75
CSIRO 24 0.774 75.99 0.920 27.67 30.90 0.434 1272.28

Regional Release metrics for CV_0:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg
AB 22 0.580 +/- 0.073 65.69 +/- 9.96 0.972 +/- 0.049 29.20 +/- 1.35 25.49 +/- 3.71 0.542 +/- 0.118
HN 21 0.620 +/- 0.109 92.70 +/- 15.86 0.943 +/- 0.092 27.55 +/- 1.34 13.13 +/- 1.84 0.427 +/- 0.066
TH 23 0.624 +/- 0.059 64.64 +/- 11.69 1.000 +/- 0.000 30.38 +/- 1.76 19.99 +/- 3.63 0.481 +/- 0.098
brain 27 0.731 +/- 0.096 93.73 +/- 9.48 0.970 +/- 0.066 26.23 +/- 0.82 13.50 +/- 2.76 1.208 +/- 0.136
pelvis 23 0.746 +/- 0.113 56.77 +/- 9.75 0.932 +/- 0.042 29.68 +/- 1.26 25.11 +/- 3.92 0.581 +/- 0.091
CSIRO 24 0.770 +/- 0.032 80.45 +/- 11.20 0.917 +/- 0.024 27.04 +/- 1.03 27.44 +/- 3.56 0.442 +/- 0.059
overall 140 0.682 +/- 0.112 76.04 +/- 18.29 0.956 +/- 0.060 28.28 +/- 1.99 20.69 +/- 6.65 0.632 +/- 0.303

Regional Release metrics for CV_1:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg
AB 22 0.590 +/- 0.063 65.69 +/- 10.19 0.972 +/- 0.047 29.19 +/- 1.37 25.32 +/- 3.88 0.537 +/- 0.115
HN 21 0.627 +/- 0.112 90.39 +/- 14.10 0.944 +/- 0.090 27.66 +/- 1.25 13.07 +/- 1.86 0.431 +/- 0.058
TH 23 0.631 +/- 0.055 64.10 +/- 11.72 1.000 +/- 0.000 30.42 +/- 1.77 19.88 +/- 3.54 0.483 +/- 0.103
brain 27 0.739 +/- 0.097 92.55 +/- 9.65 0.970 +/- 0.065 26.40 +/- 0.86 13.43 +/- 2.77 1.191 +/- 0.139
pelvis 23 0.750 +/- 0.112 55.27 +/- 9.81 0.935 +/- 0.039 29.99 +/- 1.24 25.03 +/- 3.99 0.579 +/- 0.092
CSIRO 24 0.772 +/- 0.034 82.03 +/- 10.49 0.917 +/- 0.022 26.92 +/- 0.90 28.13 +/- 3.80 0.437 +/- 0.061
overall 140 0.688 +/- 0.110 75.40 +/- 17.93 0.957 +/- 0.059 28.37 +/- 2.00 20.73 +/- 6.81 0.628 +/- 0.297

Regional Release metrics for CV_2:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg
AB 22 0.593 +/- 0.069 65.10 +/- 10.26 0.972 +/- 0.048 29.19 +/- 1.42 25.59 +/- 3.90 0.540 +/- 0.117
HN 21 0.646 +/- 0.104 84.06 +/- 12.54 0.948 +/- 0.085 27.95 +/- 1.29 12.72 +/- 1.86 0.437 +/- 0.067
TH 23 0.638 +/- 0.054 61.92 +/- 11.88 1.000 +/- 0.000 30.67 +/- 1.82 20.23 +/- 3.62 0.481 +/- 0.097
brain 27 0.753 +/- 0.098 82.15 +/- 7.73 0.972 +/- 0.063 27.06 +/- 0.78 11.80 +/- 2.32 1.207 +/- 0.132
pelvis 23 0.757 +/- 0.109 51.15 +/- 8.23 0.935 +/- 0.036 30.49 +/- 1.35 23.99 +/- 4.21 0.585 +/- 0.096
CSIRO 24 0.769 +/- 0.033 80.05 +/- 10.62 0.919 +/- 0.021 27.10 +/- 0.98 28.14 +/- 3.98 0.439 +/- 0.058
overall 140 0.696 +/- 0.108 70.98 +/- 15.90 0.958 +/- 0.057 28.69 +/- 1.99 20.29 +/- 7.17 0.634 +/- 0.302

Regional Release metrics for CV_3:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg
AB 22 0.586 +/- 0.072 64.82 +/- 10.07 0.974 +/- 0.044 29.22 +/- 1.41 25.37 +/- 3.94 0.536 +/- 0.119
HN 21 0.649 +/- 0.107 84.18 +/- 12.60 0.948 +/- 0.085 27.96 +/- 1.28 12.66 +/- 1.99 0.435 +/- 0.063
TH 23 0.639 +/- 0.056 61.98 +/- 12.31 1.000 +/- 0.000 30.59 +/- 1.88 20.09 +/- 3.62 0.478 +/- 0.093
brain 27 0.751 +/- 0.102 82.98 +/- 8.67 0.972 +/- 0.062 26.96 +/- 0.88 11.86 +/- 2.45 1.203 +/- 0.135
pelvis 23 0.752 +/- 0.112 52.13 +/- 9.38 0.938 +/- 0.035 30.44 +/- 1.40 23.98 +/- 4.07 0.584 +/- 0.093
CSIRO 24 0.772 +/- 0.035 79.75 +/- 10.80 0.918 +/- 0.022 27.15 +/- 0.95 27.48 +/- 3.31 0.448 +/- 0.056
overall 140 0.695 +/- 0.110 71.23 +/- 16.07 0.959 +/- 0.056 28.67 +/- 1.99 20.12 +/- 6.97 0.633 +/- 0.300

Regional Release metrics for CV_4:

Region n Dice MAE (HU) SSIM PSNR (dB) SAM Reg
AB 22 0.593 +/- 0.067 65.18 +/- 10.15 0.972 +/- 0.047 29.19 +/- 1.41 25.76 +/- 3.90 0.532 +/- 0.123
HN 21 0.643 +/- 0.103 84.34 +/- 12.78 0.948 +/- 0.085 27.93 +/- 1.28 12.76 +/- 1.98 0.435 +/- 0.069
TH 23 0.640 +/- 0.057 62.20 +/- 11.92 1.000 +/- 0.000 30.56 +/- 1.85 20.04 +/- 3.65 0.484 +/- 0.108
brain 27 0.751 +/- 0.092 83.10 +/- 8.84 0.972 +/- 0.062 26.94 +/- 0.90 11.72 +/- 2.62 1.211 +/- 0.134
pelvis 23 0.755 +/- 0.103 51.79 +/- 9.44 0.934 +/- 0.039 30.55 +/- 1.48 24.09 +/- 4.09 0.584 +/- 0.096
CSIRO 24 0.771 +/- 0.036 80.96 +/- 10.79 0.917 +/- 0.022 26.98 +/- 0.98 27.68 +/- 3.85 0.442 +/- 0.061
overall 140 0.696 +/- 0.106 71.53 +/- 16.25 0.957 +/- 0.057 28.64 +/- 2.04 20.22 +/- 7.13 0.634 +/- 0.305

Split files

Validation.txt

1BA131, 1BA336, 1BA253, 1BA143, 1BA175, 1BA022, 1BA189, 1BA091, 1BA328, 1BB007, 1BB076, 1BB008, 1BB072, 1BB048, 1BB095, 1BB171, 1BB109, 1BB179, 1BC014, 1BC090, 1BC027, 1BC020, 1BC019, 1BC073, 1BC083, 1BC039, 1BC009, 1PA127, 1PA174, 1PA147, 1PA163, 1PA030, 1PA138, 1PA117, 1PA164, 1PA133, 1PA111, 1PA169, 1PA113, 1PA156, 1PA098, 1PA019, 1PC006, 1PC001, 1PC036, 1PC023, 1PC015, 1PC070, 1PC010, 1PC073, 1ABA080, 1ABA044, 1ABA098, 1ABA065, 1ABA085, 1ABA099, 1ABA062, 1ABB151, 1ABB150, 1ABB011, 1ABB109, 1ABB139, 1ABB037, 1ABB161, 1ABB073, 1ABB113, 1ABB069, 1ABB061, 1ABB170, 1ABC121, 1ABC002, 1ABC007, 1HNA116, 1HNA025, 1HNA121, 1HNA061, 1HNA049, 1HNA120, 1HNA136, 1HNA133, 1HNA056, 1HNA102, 1HNA109, 1HNA089, 1HNA086, 1HNA033, 1HNC088, 1HNC003, 1HNC109, 1HNC103, 1HNC112, 1HNC046, 1HNC083, 1THA230, 1THA249, 1THA015, 1THA224, 1THA262, 1THA002, 1THA017, 1THA272, 1THA291, 1THA243, 1THB103, 1THB017, 1THB225, 1THB214, 1THB121, 1THB048, 1THB224, 1THB216, 1THB063, 1THB057, 1THB212, 1THB150, 1THB215, B006, B037, B038, B040, D031, H007, H017, J026, K008, K019, K042, M004, M015, M020, M023, M030, M036, R024, R034, R039, S028, S035, W012, W029

CrossValidation_0.txt

1BA325, 1BA185, 1BA105, 1BA368, 1BA300, 1BA085, 1BA220, 1BA294, 1BA307, 1BA288, 1BB005, 1BB073, 1BB182, 1BB200, 1BB091, 1BB039, 1BB151, 1BB145, 1BB100, 1BB062, 1BC081, 1BC004, 1BC008, 1BC086, 1BC017, 1BC085, 1BC034, 1BC028, 1BC023, 1BC036, 1PA054, 1PA012, 1PA185, 1PA180, 1PA165, 1PA063, 1PA150, 1PA059, 1PA177, 1PA025, 1PA048, 1PA151, 1PA049, 1PA081, 1PA134, 1PA118, 1PA010, 1PC004, 1PC022, 1PC027, 1PC071, 1PC080, 1PC017, 1PC069, 1PC052, 1ABA061, 1ABA081, 1ABA086, 1ABA030, 1ABA104, 1ABA103, 1ABA012, 1ABA068, 1ABB070, 1ABB053, 1ABB044, 1ABB029, 1ABB056, 1ABB009, 1ABB025, 1ABB030, 1ABB155, 1ABB039, 1ABB112, 1ABB120, 1ABB118, 1ABC016, 1ABC018, 1ABC010, 1HNA115, 1HNA029, 1HNA077, 1HNA069, 1HNA104, 1HNA084, 1HNA093, 1HNA132, 1HNA072, 1HNA019, 1HNA067, 1HNA015, 1HNA129, 1HNA135, 1HNA071, 1HNC125, 1HNC124, 1HNC076, 1HNC130, 1HNC094, 1HNC061, 1HNC084, 1THA026, 1THA286, 1THA270, 1THA207, 1THA028, 1THA283, 1THA212, 1THA213, 1THA251, 1THA261, 1THA217, 1THB074, 1THB021, 1THB043, 1THB015, 1THB058, 1THB011, 1THB135, 1THB143, 1THB003, 1THB149, 1THB072, 1THB052, 1THB035, 1THB124

CrossValidation_1.txt

1BA001, 1BA040, 1BA292, 1BA260, 1BA159, 1BA012, 1BA359, 1BA082, 1BA032, 1BA222, 1BB205, 1BB030, 1BB102, 1BB011, 1BB090, 1BB026, 1BB152, 1BB006, 1BB085, 1BB017, 1BC056, 1BC065, 1BC049, 1BC051, 1BC082, 1BC080, 1BC062, 1BC063, 1BC052, 1BC038, 1PA065, 1PA142, 1PA076, 1PA064, 1PA182, 1PA094, 1PA157, 1PA100, 1PA095, 1PA101, 1PA056, 1PA114, 1PA088, 1PA044, 1PA187, 1PA168, 1PA084, 1PC029, 1PC032, 1PC041, 1PC066, 1PC037, 1PC035, 1PC048, 1PC000, 1ABA051, 1ABA110, 1ABA054, 1ABA092, 1ABA018, 1ABA112, 1ABA071, 1ABA115, 1ABB169, 1ABB041, 1ABB116, 1ABB168, 1ABB034, 1ABB040, 1ABB036, 1ABB103, 1ABB114, 1ABB078, 1ABB135, 1ABB045, 1ABB042, 1ABC012, 1ABC122, 1ABC116, 1HNA023, 1HNA008, 1HNA032, 1HNA103, 1HNA110, 1HNA040, 1HNA105, 1HNA048, 1HNA039, 1HNA066, 1HNA012, 1HNA124, 1HNA106, 1HNA035, 1HNA097, 1HNC128, 1HNC029, 1HNC110, 1HNC004, 1HNC127, 1HNC037, 1HNC002, 1THA019, 1THA279, 1THA250, 1THA293, 1THA237, 1THA267, 1THA273, 1THA055, 1THA260, 1THA052, 1THB022, 1THB220, 1THB062, 1THB151, 1THB100, 1THB016, 1THB047, 1THB120, 1THB200, 1THB031, 1THB222, 1THB045, 1THB217, 1THB027

CrossValidation_2.txt

1BA014, 1BA278, 1BA151, 1BA206, 1BA076, 1BA116, 1BA201, 1BA058, 1BA005, 1BB096, 1BB016, 1BB034, 1BB083, 1BB071, 1BB002, 1BB051, 1BB066, 1BB111, 1BB052, 1BC084, 1BC006, 1BC077, 1BC022, 1BC046, 1BC041, 1BC010, 1BC094, 1BC074, 1BC088, 1PA073, 1PA093, 1PA152, 1PA080, 1PA026, 1PA022, 1PA105, 1PA047, 1PA178, 1PA108, 1PA159, 1PA140, 1PA188, 1PA079, 1PA005, 1PA173, 1PC063, 1PC098, 1PC007, 1PC078, 1PC019, 1PC065, 1PC042, 1PC092, 1ABA031, 1ABA060, 1ABA097, 1ABA014, 1ABA005, 1ABA019, 1ABA084, 1ABA067, 1ABB084, 1ABB062, 1ABB117, 1ABB057, 1ABB164, 1ABB143, 1ABB001, 1ABB123, 1ABB031, 1ABB058, 1ABB046, 1ABB035, 1ABB119, 1ABC019, 1ABC100, 1ABC009, 1HNA107, 1HNA014, 1HNA096, 1HNA006, 1HNA034, 1HNA053, 1HNA099, 1HNA108, 1HNA041, 1HNA082, 1HNA031, 1HNA004, 1HNA068, 1HNA142, 1HNA085, 1HNC001, 1HNC012, 1HNC043, 1HNC104, 1HNC101, 1HNC117, 1HNC031, 1THA282, 1THA039, 1THA205, 1THA001, 1THA018, 1THA005, 1THA011, 1THA244, 1THA004, 1THA288, 1THB006, 1THB095, 1THB211, 1THB076, 1THB053, 1THB134, 1THB106, 1THB028, 1THB141, 1THB068, 1THB078, 1THB179, 1THB195, 1THB226

CrossValidation_3.txt

1BA256, 1BA184, 1BA379, 1BA239, 1BA054, 1BA358, 1BA158, 1BA172, 1BA100, 1BB082, 1BB003, 1BB049, 1BB098, 1BB173, 1BB175, 1BB177, 1BB041, 1BB079, 1BB189, 1BC066, 1BC035, 1BC050, 1BC070, 1BC048, 1BC001, 1BC025, 1BC064, 1BC087, 1BC021, 1PA167, 1PA053, 1PA110, 1PA058, 1PA020, 1PA107, 1PA119, 1PA146, 1PA112, 1PA074, 1PA040, 1PA062, 1PA070, 1PA004, 1PA035, 1PA031, 1PC046, 1PC088, 1PC033, 1PC096, 1PC011, 1PC038, 1PC061, 1PC084, 1ABA113, 1ABA072, 1ABA057, 1ABA070, 1ABA102, 1ABA094, 1ABA011, 1ABA114, 1ABB153, 1ABB128, 1ABB137, 1ABB004, 1ABB173, 1ABB021, 1ABB020, 1ABB066, 1ABB102, 1ABB024, 1ABB130, 1ABB124, 1ABB054, 1ABC014, 1ABC004, 1HNA126, 1HNA143, 1HNA021, 1HNA018, 1HNA060, 1HNA091, 1HNA100, 1HNA013, 1HNA037, 1HNA010, 1HNA059, 1HNA042, 1HNA119, 1HNA130, 1HNC067, 1HNC038, 1HNC040, 1HNC068, 1HNC087, 1HNC120, 1HNC035, 1THA203, 1THA271, 1THA265, 1THA253, 1THA248, 1THA228, 1THA289, 1THA269, 1THA252, 1THA280, 1THB002, 1THB033, 1THB060, 1THB054, 1THB046, 1THB114, 1THB191, 1THB221, 1THB008, 1THB034, 1THB199, 1THB201, 1THB207, 1THB019

CrossValidation_4.txt

1BA103, 1BA234, 1BA125, 1BA075, 1BA164, 1BA345, 1BA227, 1BA266, 1BA247, 1BB059, 1BB198, 1BB050, 1BB099, 1BB075, 1BB043, 1BB028, 1BB033, 1BB184, 1BC047, 1BC076, 1BC031, 1BC075, 1BC037, 1BC058, 1BC067, 1BC054, 1BC007, 1PA176, 1PA009, 1PA086, 1PA141, 1PA041, 1PA136, 1PA060, 1PA170, 1PA024, 1PA154, 1PA083, 1PA171, 1PA148, 1PA001, 1PA011, 1PA137, 1PC054, 1PC044, 1PC039, 1PC085, 1PC049, 1PC018, 1PC059, 1PC095, 1ABA049, 1ABA082, 1ABA119, 1ABA033, 1ABA117, 1ABA087, 1ABA109, 1ABB166, 1ABB115, 1ABB067, 1ABB083, 1ABB008, 1ABB098, 1ABB002, 1ABB145, 1ABB047, 1ABB127, 1ABB059, 1ABB006, 1ABB138, 1ABC127, 1ABC008, 1HNA051, 1HNA026, 1HNA139, 1HNA047, 1HNA030, 1HNA001, 1HNA098, 1HNA113, 1HNA043, 1HNA090, 1HNA028, 1HNA141, 1HNA138, 1HNA036, 1HNC111, 1HNC107, 1HNC102, 1HNC071, 1HNC020, 1HNC121, 1HNC072, 1THA256, 1THA257, 1THA010, 1THA255, 1THA258, 1THA276, 1THA281, 1THA013, 1THA003, 1THA284, 1THB029, 1THB038, 1THB119, 1THB205, 1THB218, 1THB067, 1THB202, 1THB126, 1THB073, 1THB050, 1THB196, 1THB004, 1THB122

Notes

  • Inference uses the pipeline defined in Prediction.yml, including automatic body-mask estimation with VBoussot/TotalSegmentator-KonfAI (body, checkpoint M598.pt).
  • Evaluation uses the pipeline defined in Evaluation.yml, including segmentation consistency with TotalSegmentator-KonfAI (total-3mm, checkpoint M297.pt) and two perceptual/registration metrics:
    • IMPACTReg/1: SAM2.1/SAM2.1_Small.pt
    • IMPACTReg/2: MRSeg/MRSeg.pt