ImpactSynth / CBCT_MODEL_INFO.md
Valentin Boussot
Update whole-body sCT model
b47375f
|
Raw
History Blame Contribute Delete
17.8 kB
# ImpactSynth CBCT
## Summary
- Modality: whole-body CBCT to sCT synthesis
- Dataset source: SynthRAD 2023 and SynthRAD 2025 Task 2
- Distributed checkpoints: `CV_0.pt`, `CV_1.pt`, `CV_2.pt`, `CV_3.pt`, `CV_4.pt`
- Inference-time test-time augmentation: `tta = 2`
- Monte Carlo dropout: `false`
- Framework: KonfAI
- Architecture: 2.5D UNet++ with a ResNet34 encoder
- Main perceptual prior: SAM 2.1-s through the IMPACT-Synth loss
- Pair alignment: CT-CBCT pairs are aligned with IMPACTReg
- Transform files:
- `https://huggingface.co/datasets/VBoussot/synthrad2023-impact-registration`
- `https://huggingface.co/datasets/VBoussot/synthrad2025-impact-registration`
## Data splits
The repository contains the validation and cross-validation splits used for Task 2.
- Patients in the 2023 Task 2 training cohort: `291`
- Patients in the 2025 Task 2 training cohort: `638`
- Total patients across the paired 2023+2025 Task 2 cohorts: `929`
- Additional out-of-distribution Task 2 patients: `103`
- Region counts in the paired 2023+2025 Task 2 cohorts:
- `AB`: `195`
- `HN`: `232`
- `TH`: `211`
- `brain`: `160`
- `pelvis`: `131`
- `Validation.txt`: `150` patients
- `CrossValidation_0..4.txt` are validation folds associated with the distributed checkpoints
- `Validation.txt`: 150 patients
- `CrossValidation_0.txt`: 164 validation patients
- `CrossValidation_1.txt`: 158 validation patients
- `CrossValidation_2.txt`: 156 validation patients
- `CrossValidation_3.txt`: 153 validation patients
- `CrossValidation_4.txt`: 148 validation patients
## Release CV performance
Overall Release CV metrics:
- Dice is reported with `TS = 3 mm` on the CT body mask.
- All detailed metrics are reported in the tables below.
- Dice: `0.758 +/- 0.113`
- MAE: `53.55 +/- 17.79` HU
- SSIM: `0.939 +/- 0.026`
- PSNR: `32.09 +/- 2.93` dB
- SAM: `13.70 +/- 6.02`
- Reg: `1.04 +/- 0.03`
- Uncertainty: `784.24 +/- 278.43`
Per-fold overall Release metrics:
| Fold | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg | Uncertainty |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| CV | 150 | 0.758 +/- 0.113 | 53.55 +/- 17.79 | 0.939 +/- 0.026 | 32.09 +/- 2.93 | 13.70 +/- 6.02 | 1.04 +/- 0.03 | 784.24 +/- 278.43 |
| CV_0 | 150 | 0.744 +/- 0.114 | 59.33 +/- 18.30 | 0.927 +/- 0.028 | 31.31 +/- 2.69 | 13.25 +/- 5.32 | 1.05 +/- 0.03 | n/a |
| CV_1 | 150 | 0.755 +/- 0.112 | 58.26 +/- 17.45 | 0.931 +/- 0.028 | 31.34 +/- 2.66 | 13.24 +/- 5.48 | 1.04 +/- 0.03 | n/a |
| CV_2 | 150 | 0.751 +/- 0.114 | 57.70 +/- 17.98 | 0.931 +/- 0.028 | 31.47 +/- 2.75 | 13.25 +/- 5.49 | 1.04 +/- 0.03 | n/a |
| CV_3 | 150 | 0.748 +/- 0.115 | 57.98 +/- 18.18 | 0.931 +/- 0.028 | 31.42 +/- 2.77 | 13.09 +/- 5.30 | 1.04 +/- 0.03 | n/a |
| CV_4 | 150 | 0.750 +/- 0.113 | 57.95 +/- 18.16 | 0.931 +/- 0.028 | 31.43 +/- 2.75 | 13.03 +/- 5.32 | 1.04 +/- 0.03 | n/a |
Regional Release CV metrics:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg | Uncertainty |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.673 | 57.18 | 0.926 | 31.12 | 17.71 | 1.05 | 730.95 |
| HN | 37 | 0.717 | 67.53 | 0.946 | 29.97 | 8.85 | 1.05 | 661.14 |
| TH | 34 | 0.724 | 57.27 | 0.928 | 32.03 | 16.24 | 1.05 | 793.57 |
| brain | 26 | 0.905 | 39.42 | 0.970 | 33.96 | 7.22 | 1.01 | 879.35 |
| pelvis | 21 | 0.835 | 34.84 | 0.924 | 35.12 | 20.07 | 1.02 | 949.44 |
Regional Release metrics for CV_0:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.661 +/- 0.090 | 62.73 +/- 15.73 | 0.916 +/- 0.024 | 30.45 +/- 2.29 | 16.99 +/- 3.72 | 1.06 +/- 0.02 |
| HN | 37 | 0.704 +/- 0.074 | 73.95 +/- 16.03 | 0.936 +/- 0.024 | 29.38 +/- 2.05 | 8.92 +/- 1.39 | 1.06 +/- 0.04 |
| TH | 34 | 0.706 +/- 0.077 | 62.31 +/- 15.91 | 0.918 +/- 0.022 | 31.31 +/- 2.53 | 15.72 +/- 3.92 | 1.05 +/- 0.02 |
| brain | 26 | 0.886 +/- 0.075 | 46.50 +/- 7.67 | 0.958 +/- 0.009 | 32.86 +/- 1.43 | 7.32 +/- 1.14 | 1.02 +/- 0.00 |
| pelvis | 21 | 0.829 +/- 0.078 | 39.42 +/- 8.34 | 0.906 +/- 0.028 | 34.10 +/- 2.20 | 18.52 +/- 3.94 | 1.03 +/- 0.01 |
| overall | 150 | 0.744 +/- 0.114 | 59.33 +/- 18.30 | 0.927 +/- 0.028 | 31.31 +/- 2.69 | 13.25 +/- 5.32 | 1.05 +/- 0.03 |
Regional Release metrics for CV_1:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.668 +/- 0.084 | 61.42 +/- 14.23 | 0.919 +/- 0.024 | 30.44 +/- 2.17 | 17.18 +/- 4.16 | 1.06 +/- 0.02 |
| HN | 37 | 0.719 +/- 0.076 | 71.83 +/- 15.20 | 0.942 +/- 0.022 | 29.43 +/- 1.99 | 8.79 +/- 1.33 | 1.06 +/- 0.04 |
| TH | 34 | 0.719 +/- 0.070 | 62.74 +/- 15.15 | 0.917 +/- 0.020 | 31.26 +/- 2.47 | 15.74 +/- 3.85 | 1.05 +/- 0.02 |
| brain | 26 | 0.901 +/- 0.075 | 44.74 +/- 6.76 | 0.963 +/- 0.008 | 33.02 +/- 1.40 | 7.12 +/- 1.09 | 1.02 +/- 0.00 |
| pelvis | 21 | 0.831 +/- 0.076 | 38.99 +/- 7.73 | 0.911 +/- 0.023 | 34.13 +/- 2.26 | 18.59 +/- 4.00 | 1.03 +/- 0.01 |
| overall | 150 | 0.755 +/- 0.112 | 58.26 +/- 17.45 | 0.931 +/- 0.028 | 31.34 +/- 2.66 | 13.24 +/- 5.48 | 1.04 +/- 0.03 |
Regional Release metrics for CV_2:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.664 +/- 0.086 | 61.41 +/- 15.08 | 0.918 +/- 0.024 | 30.53 +/- 2.27 | 16.85 +/- 3.66 | 1.06 +/- 0.02 |
| HN | 37 | 0.710 +/- 0.074 | 71.52 +/- 15.44 | 0.942 +/- 0.021 | 29.53 +/- 2.05 | 8.73 +/- 1.31 | 1.06 +/- 0.04 |
| TH | 34 | 0.714 +/- 0.073 | 62.22 +/- 15.33 | 0.917 +/- 0.022 | 31.31 +/- 2.50 | 15.93 +/- 3.83 | 1.05 +/- 0.02 |
| brain | 26 | 0.898 +/- 0.072 | 43.32 +/- 7.04 | 0.965 +/- 0.007 | 33.28 +/- 1.63 | 7.13 +/- 1.06 | 1.01 +/- 0.00 |
| pelvis | 21 | 0.830 +/- 0.079 | 38.16 +/- 8.44 | 0.914 +/- 0.023 | 34.32 +/- 2.32 | 18.94 +/- 4.50 | 1.03 +/- 0.01 |
| overall | 150 | 0.751 +/- 0.114 | 57.70 +/- 17.98 | 0.931 +/- 0.028 | 31.47 +/- 2.75 | 13.25 +/- 5.49 | 1.04 +/- 0.03 |
Regional Release metrics for CV_3:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.658 +/- 0.087 | 62.08 +/- 15.29 | 0.917 +/- 0.025 | 30.47 +/- 2.32 | 17.00 +/- 3.63 | 1.06 +/- 0.02 |
| HN | 37 | 0.706 +/- 0.076 | 72.26 +/- 15.58 | 0.940 +/- 0.022 | 29.44 +/- 2.04 | 8.81 +/- 1.40 | 1.06 +/- 0.04 |
| TH | 34 | 0.717 +/- 0.075 | 61.98 +/- 15.42 | 0.918 +/- 0.022 | 31.30 +/- 2.50 | 15.61 +/- 3.89 | 1.05 +/- 0.02 |
| brain | 26 | 0.895 +/- 0.071 | 43.45 +/- 6.54 | 0.964 +/- 0.007 | 33.17 +/- 1.47 | 7.08 +/- 1.23 | 1.02 +/- 0.00 |
| pelvis | 21 | 0.832 +/- 0.077 | 38.05 +/- 8.24 | 0.913 +/- 0.025 | 34.38 +/- 2.37 | 18.06 +/- 3.95 | 1.03 +/- 0.01 |
| overall | 150 | 0.748 +/- 0.115 | 57.98 +/- 18.18 | 0.931 +/- 0.028 | 31.42 +/- 2.77 | 13.09 +/- 5.30 | 1.04 +/- 0.03 |
Regional Release metrics for CV_4:
| Region | n | Dice | MAE (HU) | SSIM | PSNR (dB) | SAM | Reg |
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
| AB | 32 | 0.662 +/- 0.087 | 61.60 +/- 15.14 | 0.918 +/- 0.025 | 30.49 +/- 2.30 | 16.73 +/- 3.58 | 1.06 +/- 0.02 |
| HN | 37 | 0.711 +/- 0.075 | 71.79 +/- 15.70 | 0.941 +/- 0.022 | 29.48 +/- 2.06 | 8.71 +/- 1.37 | 1.06 +/- 0.04 |
| TH | 34 | 0.716 +/- 0.073 | 62.64 +/- 15.68 | 0.918 +/- 0.021 | 31.25 +/- 2.44 | 15.62 +/- 3.76 | 1.05 +/- 0.02 |
| brain | 26 | 0.895 +/- 0.071 | 43.27 +/- 6.67 | 0.964 +/- 0.007 | 33.27 +/- 1.48 | 6.98 +/- 1.13 | 1.01 +/- 0.00 |
| pelvis | 21 | 0.830 +/- 0.078 | 38.55 +/- 9.06 | 0.914 +/- 0.023 | 34.31 +/- 2.31 | 18.26 +/- 4.22 | 1.03 +/- 0.01 |
| overall | 150 | 0.750 +/- 0.113 | 57.95 +/- 18.16 | 0.931 +/- 0.028 | 31.43 +/- 2.75 | 13.03 +/- 5.32 | 1.04 +/- 0.03 |
## Split files
### Validation.txt
`2BA047`, `2BA092`, `2BA011`, `2BA083`, `2BA073`, `2BA006`, `2BA001`, `2BA056`, `2BA053`, `2BB062`, `2BB008`, `2BB044`, `2BB095`, `2BB048`, `2BB111`, `2BB026`, `2BB076`, `2BB005`, `2BC075`, `2BC012`, `2BC068`, `2BC010`, `2BC047`, `2BC055`, `2BC085`, `2BC082`, `2PA064`, `2PA016`, `2PA078`, `2PA006`, `2PA055`, `2PA007`, `2PA002`, `2PB110`, `2PB082`, `2PB093`, `2PB021`, `2PB043`, `2PB106`, `2PB004`, `2PC047`, `2PC060`, `2PC013`, `2PC021`, `2PC053`, `2PC096`, `2PC017`, `2ABA082`, `2ABA118`, `2ABA103`, `2ABA135`, `2ABA006`, `2ABA024`, `2ABA077`, `2ABA066`, `2ABB061`, `2ABB059`, `2ABB095`, `2ABB090`, `2ABB117`, `2ABB051`, `2ABB039`, `2ABB018`, `2ABC222`, `2ABC093`, `2ABC049`, `2ABC019`, `2ABC150`, `2ABC063`, `2ABC152`, `2ABC118`, `2ABE158`, `2ABE197`, `2ABE191`, `2ABE169`, `2ABE124`, `2ABE022`, `2ABE184`, `2ABE180`, `2HNA084`, `2HNA005`, `2HNA050`, `2HNA002`, `2HNA058`, `2HNA024`, `2HNA032`, `2HNA110`, `2HNA100`, `2HNA098`, `2HNB105`, `2HNB099`, `2HNB044`, `2HNB067`, `2HNB089`, `2HNB015`, `2HNB047`, `2HNB019`, `2HNB075`, `2HNC028`, `2HNC024`, `2HNC099`, `2HNC078`, `2HNC077`, `2HNC043`, `2HNC021`, `2HNC060`, `2HNC036`, `2HNE054`, `2HNE010`, `2HNE101`, `2HNE079`, `2HNE026`, `2HNE075`, `2HNE007`, `2HNE042`, `2HNE041`, `2THA113`, `2THA043`, `2THA117`, `2THA122`, `2THA005`, `2THA077`, `2THA101`, `2THA082`, `2THA099`, `2THB059`, `2THB038`, `2THB088`, `2THB055`, `2THB015`, `2THB031`, `2THB046`, `2THB014`, `2THC037`, `2THC102`, `2THC107`, `2THC097`, `2THC033`, `2THC068`, `2THC076`, `2THC111`, `2THC056`, `2THE119`, `2THE081`, `2THE069`, `2THE058`, `2THE040`, `2THE046`, `2THE099`, `2THE039`
### CrossValidation_0.txt
`2BA040`, `2BA058`, `2BA023`, `2BA027`, `2BA041`, `2BA064`, `2BA061`, `2BA009`, `2BA071`, `2BA055`, `2BB034`, `2BB003`, `2BB189`, `2BB033`, `2BB030`, `2BB090`, `2BB173`, `2BB145`, `2BB200`, `2BC048`, `2BC027`, `2BC042`, `2BC015`, `2BC089`, `2BC046`, `2BC001`, `2BC044`, `2BC090`, `2PA045`, `2PA074`, `2PA066`, `2PA017`, `2PA053`, `2PA069`, `2PA024`, `2PA070`, `2PB081`, `2PB087`, `2PB109`, `2PB070`, `2PB104`, `2PB003`, `2PB033`, `2PC049`, `2PC007`, `2PC029`, `2PC050`, `2PC063`, `2PC019`, `2PC008`, `2PC010`, `2ABA068`, `2ABA122`, `2ABA041`, `2ABA044`, `2ABA101`, `2ABA051`, `2ABA027`, `2ABA110`, `2ABA138`, `2ABB078`, `2ABB009`, `2ABB002`, `2ABB105`, `2ABB036`, `2ABB040`, `2ABB115`, `2ABB056`, `2ABB006`, `2ABC212`, `2ABC036`, `2ABC188`, `2ABC102`, `2ABC079`, `2ABC176`, `2ABC040`, `2ABC114`, `2ABE200`, `2ABE174`, `2ABE131`, `2ABE126`, `2ABE165`, `2ABE162`, `2ABE038`, `2ABE136`, `2HNA092`, `2HNA033`, `2HNA044`, `2HNA021`, `2HNA025`, `2HNA095`, `2HNA011`, `2HNA107`, `2HNA046`, `2HNA088`, `2HNA040`, `2HNB006`, `2HNB010`, `2HNB058`, `2HNB039`, `2HNB007`, `2HNB024`, `2HNB086`, `2HNB023`, `2HNB102`, `2HNB078`, `2HNC100`, `2HNC049`, `2HNC091`, `2HNC088`, `2HNC113`, `2HNC062`, `2HNC034`, `2HNC082`, `2HNC112`, `2HNC119`, `2HNE092`, `2HNE109`, `2HNE105`, `2HNE037`, `2HNE086`, `2HNE087`, `2HNE043`, `2HNE067`, `2HNE070`, `2HNE089`, `2THA056`, `2THA084`, `2THA132`, `2THA045`, `2THA081`, `2THA123`, `2THA052`, `2THA066`, `2THA092`, `2THA017`, `2THB106`, `2THB058`, `2THB068`, `2THB009`, `2THB064`, `2THB052`, `2THB098`, `2THB109`, `2THB026`, `2THC032`, `2THC099`, `2THC002`, `2THC067`, `2THC112`, `2THC091`, `2THC095`, `2THC117`, `2THC092`, `2THC084`, `2THE049`, `2THE080`, `2THE014`, `2THE015`, `2THE020`, `2THE117`, `2THE001`, `2THE006`, `2THE071`
### CrossValidation_1.txt
`2BA014`, `2BA039`, `2BA013`, `2BA049`, `2BA077`, `2BA066`, `2BA044`, `2BA051`, `2BA012`, `2BB082`, `2BB028`, `2BB099`, `2BB071`, `2BB066`, `2BB109`, `2BB051`, `2BB002`, `2BB100`, `2BC011`, `2BC021`, `2BC024`, `2BC043`, `2BC030`, `2BC033`, `2BC051`, `2BC061`, `2BC038`, `2PA088`, `2PA035`, `2PA012`, `2PA061`, `2PA037`, `2PA062`, `2PA063`, `2PA036`, `2PB057`, `2PB013`, `2PB117`, `2PB060`, `2PB024`, `2PB096`, `2PB084`, `2PC066`, `2PC097`, `2PC051`, `2PC041`, `2PC082`, `2PC069`, `2PC036`, `2PC042`, `2ABA075`, `2ABA032`, `2ABA038`, `2ABA064`, `2ABA005`, `2ABA048`, `2ABA037`, `2ABA136`, `2ABB043`, `2ABB113`, `2ABB015`, `2ABB005`, `2ABB033`, `2ABB087`, `2ABB024`, `2ABB029`, `2ABB100`, `2ABC018`, `2ABC094`, `2ABC146`, `2ABC089`, `2ABC066`, `2ABC151`, `2ABC230`, `2ABC109`, `2ABE187`, `2ABE120`, `2ABE107`, `2ABE010`, `2ABE170`, `2ABE206`, `2ABE073`, `2ABE177`, `2HNA083`, `2HNA113`, `2HNA097`, `2HNA014`, `2HNA045`, `2HNA068`, `2HNA039`, `2HNA089`, `2HNA041`, `2HNA082`, `2HNB002`, `2HNB065`, `2HNB107`, `2HNB085`, `2HNB054`, `2HNB081`, `2HNB091`, `2HNB093`, `2HNB045`, `2HNB071`, `2HNC097`, `2HNC087`, `2HNC042`, `2HNC101`, `2HNC108`, `2HNC057`, `2HNC085`, `2HNC030`, `2HNC055`, `2HNC123`, `2HNE103`, `2HNE083`, `2HNE006`, `2HNE050`, `2HNE018`, `2HNE093`, `2HNE049`, `2HNE028`, `2HNE095`, `2HNE084`, `2THA075`, `2THA107`, `2THA106`, `2THA070`, `2THA141`, `2THA069`, `2THA074`, `2THA022`, `2THA144`, `2THB004`, `2THB117`, `2THB063`, `2THB082`, `2THB101`, `2THB125`, `2THB120`, `2THB019`, `2THB115`, `2THC060`, `2THC029`, `2THC022`, `2THC045`, `2THC119`, `2THC017`, `2THC016`, `2THC116`, `2THC005`, `2THE068`, `2THE028`, `2THE109`, `2THE089`, `2THE035`, `2THE022`, `2THE021`, `2THE107`
### CrossValidation_2.txt
`2BA069`, `2BA037`, `2BA008`, `2BA063`, `2BA067`, `2BA028`, `2BA090`, `2BA094`, `2BA004`, `2BB179`, `2BB041`, `2BB075`, `2BB049`, `2BB177`, `2BB205`, `2BB052`, `2BB011`, `2BB017`, `2BC073`, `2BC022`, `2BC056`, `2BC007`, `2BC059`, `2BC026`, `2BC023`, `2BC050`, `2BC064`, `2PA081`, `2PA030`, `2PA058`, `2PA095`, `2PA050`, `2PA005`, `2PA038`, `2PB055`, `2PB080`, `2PB092`, `2PB030`, `2PB056`, `2PB048`, `2PB007`, `2PC034`, `2PC091`, `2PC002`, `2PC026`, `2PC003`, `2PC087`, `2PC012`, `2PC037`, `2ABA039`, `2ABA133`, `2ABA109`, `2ABA084`, `2ABA132`, `2ABA030`, `2ABA043`, `2ABA040`, `2ABB121`, `2ABB065`, `2ABB096`, `2ABB086`, `2ABB085`, `2ABB120`, `2ABB047`, `2ABB093`, `2ABB034`, `2ABC035`, `2ABC097`, `2ABC132`, `2ABC059`, `2ABC142`, `2ABC129`, `2ABC177`, `2ABC137`, `2ABE088`, `2ABE114`, `2ABE152`, `2ABE150`, `2ABE172`, `2ABE201`, `2ABE189`, `2ABE141`, `2HNA086`, `2HNA108`, `2HNA047`, `2HNA111`, `2HNA104`, `2HNA035`, `2HNA077`, `2HNA036`, `2HNA034`, `2HNA087`, `2HNB063`, `2HNB098`, `2HNB055`, `2HNB082`, `2HNB053`, `2HNB020`, `2HNB037`, `2HNB050`, `2HNB011`, `2HNB109`, `2HNC066`, `2HNC052`, `2HNC086`, `2HNC048`, `2HNC081`, `2HNC029`, `2HNC058`, `2HNC121`, `2HNC118`, `2HNE107`, `2HNE072`, `2HNE030`, `2HNE003`, `2HNE036`, `2HNE068`, `2HNE108`, `2HNE104`, `2HNE051`, `2HNE090`, `2THA140`, `2THA105`, `2THA058`, `2THA076`, `2THA047`, `2THA136`, `2THA030`, `2THA065`, `2THA059`, `2THB036`, `2THB030`, `2THB035`, `2THB070`, `2THB040`, `2THB007`, `2THB017`, `2THB094`, `2THB104`, `2THC030`, `2THC108`, `2THC073`, `2THC080`, `2THC085`, `2THC042`, `2THC094`, `2THC090`, `2THC001`, `2THE105`, `2THE072`, `2THE066`, `2THE010`, `2THE083`, `2THE101`, `2THE019`, `2THE023`
### CrossValidation_3.txt
`2BA076`, `2BA002`, `2BA035`, `2BA025`, `2BA085`, `2BA030`, `2BA029`, `2BA052`, `2BA080`, `2BB091`, `2BB182`, `2BB073`, `2BB059`, `2BB007`, `2BB152`, `2BB079`, `2BB098`, `2BB043`, `2BC070`, `2BC017`, `2BC019`, `2BC076`, `2BC081`, `2BC045`, `2BC074`, `2BC016`, `2PA019`, `2PA092`, `2PA040`, `2PA049`, `2PA026`, `2PA003`, `2PA059`, `2PB121`, `2PB119`, `2PB126`, `2PB068`, `2PB026`, `2PB083`, `2PB022`, `2PC080`, `2PC005`, `2PC058`, `2PC052`, `2PC039`, `2PC070`, `2PC015`, `2PC098`, `2ABA128`, `2ABA098`, `2ABA115`, `2ABA126`, `2ABA047`, `2ABA002`, `2ABA046`, `2ABA130`, `2ABB119`, `2ABB022`, `2ABB019`, `2ABB106`, `2ABB011`, `2ABB032`, `2ABB072`, `2ABB108`, `2ABC011`, `2ABC038`, `2ABC065`, `2ABC199`, `2ABC085`, `2ABC135`, `2ABC043`, `2ABC168`, `2ABE144`, `2ABE128`, `2ABE173`, `2ABE121`, `2ABE145`, `2ABE209`, `2ABE140`, `2ABE125`, `2HNA019`, `2HNA027`, `2HNA099`, `2HNA105`, `2HNA031`, `2HNA106`, `2HNA102`, `2HNA073`, `2HNA026`, `2HNA091`, `2HNB070`, `2HNB051`, `2HNB064`, `2HNB059`, `2HNB108`, `2HNB009`, `2HNB043`, `2HNB106`, `2HNB101`, `2HNB031`, `2HNC051`, `2HNC061`, `2HNC094`, `2HNC084`, `2HNC072`, `2HNC018`, `2HNC125`, `2HNC080`, `2HNC053`, `2HNE031`, `2HNE012`, `2HNE076`, `2HNE011`, `2HNE024`, `2HNE001`, `2HNE097`, `2HNE046`, `2HNE064`, `2THA097`, `2THA131`, `2THA108`, `2THA040`, `2THA019`, `2THA139`, `2THA126`, `2THA048`, `2THA096`, `2THB039`, `2THB053`, `2THB023`, `2THB072`, `2THB057`, `2THB079`, `2THB087`, `2THB011`, `2THB043`, `2THC025`, `2THC063`, `2THC015`, `2THC104`, `2THC020`, `2THC072`, `2THC040`, `2THC077`, `2THC011`, `2THE114`, `2THE104`, `2THE003`, `2THE042`, `2THE025`, `2THE004`, `2THE013`, `2THE097`
### CrossValidation_4.txt
`2BA003`, `2BA032`, `2BA010`, `2BA024`, `2BA031`, `2BA068`, `2BA036`, `2BA007`, `2BA045`, `2BB083`, `2BB072`, `2BB050`, `2BB198`, `2BB006`, `2BB151`, `2BB039`, `2BB096`, `2BB171`, `2BC072`, `2BC071`, `2BC040`, `2BC057`, `2BC086`, `2BC013`, `2BC088`, `2BC018`, `2PA056`, `2PA075`, `2PA067`, `2PA015`, `2PA047`, `2PA048`, `2PA073`, `2PB050`, `2PB125`, `2PB098`, `2PB036`, `2PB114`, `2PB018`, `2PC092`, `2PC024`, `2PC065`, `2PC011`, `2PC032`, `2PC073`, `2PC075`, `2ABA102`, `2ABA094`, `2ABA086`, `2ABA134`, `2ABA071`, `2ABA143`, `2ABA031`, `2ABA008`, `2ABB042`, `2ABB054`, `2ABB053`, `2ABB092`, `2ABB118`, `2ABB004`, `2ABB025`, `2ABB037`, `2ABC051`, `2ABC122`, `2ABC229`, `2ABC017`, `2ABC010`, `2ABC171`, `2ABC130`, `2ABC156`, `2ABE130`, `2ABE207`, `2ABE119`, `2ABE135`, `2ABE159`, `2ABE208`, `2ABE185`, `2HNA029`, `2HNA016`, `2HNA056`, `2HNA028`, `2HNA093`, `2HNA070`, `2HNA090`, `2HNA094`, `2HNA010`, `2HNA076`, `2HNB001`, `2HNB104`, `2HNB072`, `2HNB014`, `2HNB033`, `2HNB103`, `2HNB030`, `2HNB016`, `2HNB111`, `2HNC017`, `2HNC063`, `2HNC025`, `2HNC075`, `2HNC020`, `2HNC079`, `2HNC037`, `2HNC040`, `2HNC117`, `2HNE023`, `2HNE100`, `2HNE059`, `2HNE106`, `2HNE022`, `2HNE098`, `2HNE102`, `2HNE034`, `2HNE060`, `2THA010`, `2THA124`, `2THA115`, `2THA062`, `2THA078`, `2THA039`, `2THA034`, `2THA103`, `2THA146`, `2THB133`, `2THB003`, `2THB021`, `2THB051`, `2THB129`, `2THB074`, `2THB111`, `2THB002`, `2THC061`, `2THC019`, `2THC109`, `2THC105`, `2THC126`, `2THC114`, `2THC101`, `2THC039`, `2THC089`, `2THE106`, `2THE060`, `2THE077`, `2THE115`, `2THE100`, `2THE031`, `2THE045`, `2THE112`