Add universal + breast vSHARP checkpoints; refresh READMEs and inference YAMLs
Browse files- README.md +13 -7
- vsharp_brain.yaml +2 -0
- vsharp_breast.pt +3 -0
- vsharp_breast.yaml +59 -0
- vsharp_cardiac.yaml +2 -0
- vsharp_knee.yaml +2 -0
- vsharp_prostate.yaml +2 -0
- vsharp_universal.pt +3 -0
- vsharp_universal.yaml +59 -0
README.md
CHANGED
|
@@ -12,27 +12,29 @@ pipeline_tag: image-to-image
|
|
| 12 |
|
| 13 |
# DIRECT — vSHARP multi-anatomy
|
| 14 |
|
| 15 |
-
Pretrained [vSHARP](https://arxiv.org/abs/2309.09954)
|
| 16 |
|
| 17 |
```text
|
| 18 |
-
vsharp_<
|
| 19 |
-
vsharp_<
|
| 20 |
```
|
| 21 |
|
| 22 |
Paper: [arXiv:2309.09954](https://arxiv.org/abs/2309.09954) · Framework: [DIRECT](https://github.com/NKI-AI/direct)
|
| 23 |
|
| 24 |
## Datasets
|
| 25 |
|
| 26 |
-
| Model |
|
| 27 |
-
|-------|---------|------|
|
| 28 |
| `vsharp_brain` | fastMRI brain (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 29 |
| `vsharp_knee` | fastMRI knee (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 30 |
| `vsharp_prostate` | fastMRI prostate (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
|
|
|
| 31 |
| `vsharp_cardiac` | CMRxRecon 2023 cine (multi-coil) | [cmrxrecon.github.io](https://cmrxrecon.github.io/) |
|
|
|
|
| 32 |
|
| 33 |
## Training protocol
|
| 34 |
|
| 35 |
-
These models were **not** trained at a single fixed acceleration or scheme.
|
| 36 |
|
| 37 |
| | Values |
|
| 38 |
|---|---|
|
|
@@ -40,6 +42,8 @@ These models were **not** trained at a single fixed acceleration or scheme. Ever
|
|
| 40 |
| Center fractions (ACS) | `0.16, 0.08, 0.06, 0.04, 0.02` (paired with \(R\): 2→0.16, 4→0.08, 6→0.06, 8→0.04, 10→0.02) |
|
| 41 |
| Sampling schemes | FastMRIEquispaced, FastMRIRandom, Gaussian1D, Gaussian2D, VariableDensityPoisson, Radial |
|
| 42 |
|
|
|
|
|
|
|
| 43 |
## Files & default inference masks
|
| 44 |
|
| 45 |
Released YAMLs are **inference-only** (no `training` / `validation` blocks). Each pins **one** acceleration and **one** ACS fraction — DIRECT’s mask sampler draws randomly from lists, so multi-\(R\) lists belong in training only.
|
|
@@ -49,7 +53,9 @@ Released YAMLs are **inference-only** (no `training` / `validation` blocks). Eac
|
|
| 49 |
| `vsharp_brain.{yaml,pt}` | FastMRIRandom | 4× / 0.08 |
|
| 50 |
| `vsharp_knee.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
| 51 |
| `vsharp_prostate.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
|
|
|
| 52 |
| `vsharp_cardiac.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
|
|
|
| 53 |
|
| 54 |
## Changing acceleration or scheme
|
| 55 |
|
|
@@ -122,7 +128,7 @@ If you use these models or [DIRECT](https://github.com/NKI-AI/direct), please ci
|
|
| 122 |
|
| 123 |
```bibtex
|
| 124 |
@article{yiasemis2024vsharp,
|
| 125 |
-
title={vSHARP: variable Splitting Half-quadratic ADMM algorithm for Reconstruction of inverse Problems},
|
| 126 |
author={Yiasemis, George and Moriakov, Nikita and S{\'a}nchez, Clara I. and Sonke, Jan-Jakob and Teuwen, Jonas},
|
| 127 |
journal={Magnetic Resonance Materials in Physics, Biology and Medicine},
|
| 128 |
year={2024},
|
|
|
|
| 12 |
|
| 13 |
# DIRECT — vSHARP multi-anatomy
|
| 14 |
|
| 15 |
+
Pretrained [vSHARP](https://arxiv.org/abs/2309.09954) models for multi-coil MRI reconstruction. Each release is an inference-ready pair:
|
| 16 |
|
| 17 |
```text
|
| 18 |
+
vsharp_<name>.yaml # inference-only DIRECT config
|
| 19 |
+
vsharp_<name>.pt # weights (ModConv layout)
|
| 20 |
```
|
| 21 |
|
| 22 |
Paper: [arXiv:2309.09954](https://arxiv.org/abs/2309.09954) · Framework: [DIRECT](https://github.com/NKI-AI/direct)
|
| 23 |
|
| 24 |
## Datasets
|
| 25 |
|
| 26 |
+
| Model | Training data | Link |
|
| 27 |
+
|-------|---------------|------|
|
| 28 |
| `vsharp_brain` | fastMRI brain (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 29 |
| `vsharp_knee` | fastMRI knee (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 30 |
| `vsharp_prostate` | fastMRI prostate (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 31 |
+
| `vsharp_breast` | fastMRI breast (multi-coil) | [fastmri.med.nyu.edu](https://fastmri.med.nyu.edu/) |
|
| 32 |
| `vsharp_cardiac` | CMRxRecon 2023 cine (multi-coil) | [cmrxrecon.github.io](https://cmrxrecon.github.io/) |
|
| 33 |
+
| `vsharp_universal` | Mixed: fastMRI brain/knee/prostate/breast + CMRxRecon 2023/2024/2025 | [fastMRI](https://fastmri.med.nyu.edu/) · [CMRxRecon](https://cmrxrecon.github.io/) |
|
| 34 |
|
| 35 |
## Training protocol
|
| 36 |
|
| 37 |
+
These models were **not** trained at a single fixed acceleration or scheme. All used the same mixed schedule:
|
| 38 |
|
| 39 |
| | Values |
|
| 40 |
|---|---|
|
|
|
|
| 42 |
| Center fractions (ACS) | `0.16, 0.08, 0.06, 0.04, 0.02` (paired with \(R\): 2→0.16, 4→0.08, 6→0.06, 8→0.04, 10→0.02) |
|
| 43 |
| Sampling schemes | FastMRIEquispaced, FastMRIRandom, Gaussian1D, Gaussian2D, VariableDensityPoisson, Radial |
|
| 44 |
|
| 45 |
+
`vsharp_universal` was trained jointly across the anatomies / challenges above; anatomy-specific models were trained on one dataset each.
|
| 46 |
+
|
| 47 |
## Files & default inference masks
|
| 48 |
|
| 49 |
Released YAMLs are **inference-only** (no `training` / `validation` blocks). Each pins **one** acceleration and **one** ACS fraction — DIRECT’s mask sampler draws randomly from lists, so multi-\(R\) lists belong in training only.
|
|
|
|
| 53 |
| `vsharp_brain.{yaml,pt}` | FastMRIRandom | 4× / 0.08 |
|
| 54 |
| `vsharp_knee.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
| 55 |
| `vsharp_prostate.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
| 56 |
+
| `vsharp_breast.{yaml,pt}` | Radial | 4× / 0.08 |
|
| 57 |
| `vsharp_cardiac.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
| 58 |
+
| `vsharp_universal.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
|
| 59 |
|
| 60 |
## Changing acceleration or scheme
|
| 61 |
|
|
|
|
| 128 |
|
| 129 |
```bibtex
|
| 130 |
@article{yiasemis2024vsharp,
|
| 131 |
+
title={vSHARP: variable Splitting Half-quadratic {ADMM} algorithm for Reconstruction of inverse Problems},
|
| 132 |
author={Yiasemis, George and Moriakov, Nikita and S{\'a}nchez, Clara I. and Sonke, Jan-Jakob and Teuwen, Jonas},
|
| 133 |
journal={Magnetic Resonance Materials in Physics, Biology and Medicine},
|
| 134 |
year={2024},
|
vsharp_brain.yaml
CHANGED
|
@@ -23,6 +23,7 @@ model:
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
|
|
|
| 26 |
additional_models:
|
| 27 |
sensitivity_model:
|
| 28 |
model_name: unet.unet_2d.UnetModel2d
|
|
@@ -31,6 +32,7 @@ additional_models:
|
|
| 31 |
num_filters: 16
|
| 32 |
num_pool_layers: 5
|
| 33 |
dropout_probability: 0.0
|
|
|
|
| 34 |
physics:
|
| 35 |
forward_operator: fft2
|
| 36 |
backward_operator: ifft2
|
|
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
additional_models:
|
| 28 |
sensitivity_model:
|
| 29 |
model_name: unet.unet_2d.UnetModel2d
|
|
|
|
| 32 |
num_filters: 16
|
| 33 |
num_pool_layers: 5
|
| 34 |
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
physics:
|
| 37 |
forward_operator: fft2
|
| 38 |
backward_operator: ifft2
|
vsharp_breast.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ea6d1e8bc7f3f6c4d1c22415a26dd7d41378039287663cd83237ea3dba0713a4
|
| 3 |
+
size 529175381
|
vsharp_breast.yaml
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model:
|
| 2 |
+
model_name: vsharp.vsharp.VSharpNet
|
| 3 |
+
num_steps: 16
|
| 4 |
+
num_steps_dc_gd: 12
|
| 5 |
+
image_init: SENSE
|
| 6 |
+
no_parameter_sharing: true
|
| 7 |
+
auxiliary_steps: -1
|
| 8 |
+
image_model_architecture: UNET
|
| 9 |
+
initializer_channels:
|
| 10 |
+
- 32
|
| 11 |
+
- 32
|
| 12 |
+
- 32
|
| 13 |
+
- 64
|
| 14 |
+
- 64
|
| 15 |
+
initializer_dilations:
|
| 16 |
+
- 1
|
| 17 |
+
- 1
|
| 18 |
+
- 2
|
| 19 |
+
- 4
|
| 20 |
+
- 8
|
| 21 |
+
initializer_multiscale: 1
|
| 22 |
+
initializer_activation: PRELU
|
| 23 |
+
image_unet_num_filters: 16
|
| 24 |
+
image_unet_num_pool_layers: 5
|
| 25 |
+
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
+
additional_models:
|
| 28 |
+
sensitivity_model:
|
| 29 |
+
model_name: unet.unet_2d.UnetModel2d
|
| 30 |
+
in_channels: 2
|
| 31 |
+
out_channels: 2
|
| 32 |
+
num_filters: 16
|
| 33 |
+
num_pool_layers: 5
|
| 34 |
+
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
+
physics:
|
| 37 |
+
forward_operator: fft2
|
| 38 |
+
backward_operator: ifft2
|
| 39 |
+
inference:
|
| 40 |
+
batch_size: 1
|
| 41 |
+
crop: header
|
| 42 |
+
dataset:
|
| 43 |
+
name: FastMRI
|
| 44 |
+
transforms:
|
| 45 |
+
use_seed: true
|
| 46 |
+
delete_kspace: false
|
| 47 |
+
masking:
|
| 48 |
+
name: Radial
|
| 49 |
+
accelerations:
|
| 50 |
+
- 4
|
| 51 |
+
center_fractions:
|
| 52 |
+
- 0.08
|
| 53 |
+
cropping:
|
| 54 |
+
image_center_crop: false
|
| 55 |
+
sensitivity_map_estimation:
|
| 56 |
+
estimate_sensitivity_maps: true
|
| 57 |
+
normalization:
|
| 58 |
+
scaling_key: masked_kspace
|
| 59 |
+
scale_percentile: 0.995
|
vsharp_cardiac.yaml
CHANGED
|
@@ -23,6 +23,7 @@ model:
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
|
|
|
| 26 |
additional_models:
|
| 27 |
sensitivity_model:
|
| 28 |
model_name: unet.unet_2d.UnetModel2d
|
|
@@ -31,6 +32,7 @@ additional_models:
|
|
| 31 |
num_filters: 16
|
| 32 |
num_pool_layers: 5
|
| 33 |
dropout_probability: 0.0
|
|
|
|
| 34 |
physics:
|
| 35 |
forward_operator: fft2
|
| 36 |
backward_operator: ifft2
|
|
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
additional_models:
|
| 28 |
sensitivity_model:
|
| 29 |
model_name: unet.unet_2d.UnetModel2d
|
|
|
|
| 32 |
num_filters: 16
|
| 33 |
num_pool_layers: 5
|
| 34 |
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
physics:
|
| 37 |
forward_operator: fft2
|
| 38 |
backward_operator: ifft2
|
vsharp_knee.yaml
CHANGED
|
@@ -23,6 +23,7 @@ model:
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
|
|
|
| 26 |
additional_models:
|
| 27 |
sensitivity_model:
|
| 28 |
model_name: unet.unet_2d.UnetModel2d
|
|
@@ -31,6 +32,7 @@ additional_models:
|
|
| 31 |
num_filters: 16
|
| 32 |
num_pool_layers: 5
|
| 33 |
dropout_probability: 0.0
|
|
|
|
| 34 |
physics:
|
| 35 |
forward_operator: fft2
|
| 36 |
backward_operator: ifft2
|
|
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
additional_models:
|
| 28 |
sensitivity_model:
|
| 29 |
model_name: unet.unet_2d.UnetModel2d
|
|
|
|
| 32 |
num_filters: 16
|
| 33 |
num_pool_layers: 5
|
| 34 |
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
physics:
|
| 37 |
forward_operator: fft2
|
| 38 |
backward_operator: ifft2
|
vsharp_prostate.yaml
CHANGED
|
@@ -23,6 +23,7 @@ model:
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
|
|
|
| 26 |
additional_models:
|
| 27 |
sensitivity_model:
|
| 28 |
model_name: unet.unet_2d.UnetModel2d
|
|
@@ -31,6 +32,7 @@ additional_models:
|
|
| 31 |
num_filters: 16
|
| 32 |
num_pool_layers: 5
|
| 33 |
dropout_probability: 0.0
|
|
|
|
| 34 |
physics:
|
| 35 |
forward_operator: fft2
|
| 36 |
backward_operator: ifft2
|
|
|
|
| 23 |
image_unet_num_filters: 16
|
| 24 |
image_unet_num_pool_layers: 5
|
| 25 |
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
additional_models:
|
| 28 |
sensitivity_model:
|
| 29 |
model_name: unet.unet_2d.UnetModel2d
|
|
|
|
| 32 |
num_filters: 16
|
| 33 |
num_pool_layers: 5
|
| 34 |
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
physics:
|
| 37 |
forward_operator: fft2
|
| 38 |
backward_operator: ifft2
|
vsharp_universal.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:28dcddf75a16f12094c97e45e7b5e43d81b4b69bc64d6273e1e330a91c9c0f60
|
| 3 |
+
size 529176923
|
vsharp_universal.yaml
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model:
|
| 2 |
+
model_name: vsharp.vsharp.VSharpNet
|
| 3 |
+
num_steps: 16
|
| 4 |
+
num_steps_dc_gd: 12
|
| 5 |
+
image_init: SENSE
|
| 6 |
+
no_parameter_sharing: true
|
| 7 |
+
auxiliary_steps: -1
|
| 8 |
+
image_model_architecture: UNET
|
| 9 |
+
initializer_channels:
|
| 10 |
+
- 32
|
| 11 |
+
- 32
|
| 12 |
+
- 32
|
| 13 |
+
- 64
|
| 14 |
+
- 64
|
| 15 |
+
initializer_dilations:
|
| 16 |
+
- 1
|
| 17 |
+
- 1
|
| 18 |
+
- 2
|
| 19 |
+
- 4
|
| 20 |
+
- 8
|
| 21 |
+
initializer_multiscale: 1
|
| 22 |
+
initializer_activation: PRELU
|
| 23 |
+
image_unet_num_filters: 16
|
| 24 |
+
image_unet_num_pool_layers: 5
|
| 25 |
+
image_unet_dropout: 0.0
|
| 26 |
+
image_unet_conv_out_bias: true
|
| 27 |
+
additional_models:
|
| 28 |
+
sensitivity_model:
|
| 29 |
+
model_name: unet.unet_2d.UnetModel2d
|
| 30 |
+
in_channels: 2
|
| 31 |
+
out_channels: 2
|
| 32 |
+
num_filters: 16
|
| 33 |
+
num_pool_layers: 5
|
| 34 |
+
dropout_probability: 0.0
|
| 35 |
+
conv_out_bias: true
|
| 36 |
+
physics:
|
| 37 |
+
forward_operator: fft2
|
| 38 |
+
backward_operator: ifft2
|
| 39 |
+
inference:
|
| 40 |
+
batch_size: 1
|
| 41 |
+
crop: header
|
| 42 |
+
dataset:
|
| 43 |
+
name: FastMRI
|
| 44 |
+
transforms:
|
| 45 |
+
use_seed: true
|
| 46 |
+
delete_kspace: false
|
| 47 |
+
masking:
|
| 48 |
+
name: FastMRIEquispaced
|
| 49 |
+
accelerations:
|
| 50 |
+
- 4
|
| 51 |
+
center_fractions:
|
| 52 |
+
- 0.08
|
| 53 |
+
cropping:
|
| 54 |
+
image_center_crop: false
|
| 55 |
+
sensitivity_map_estimation:
|
| 56 |
+
estimate_sensitivity_maps: true
|
| 57 |
+
normalization:
|
| 58 |
+
scaling_key: masked_kspace
|
| 59 |
+
scale_percentile: 0.995
|