File size: 6,135 Bytes
7a28690
 
 
 
 
 
 
 
 
d3826b7
7a28690
 
f8b4ccb
7a28690
b457626
7a28690
d3826b7
b457626
e2e5c8c
d3826b7
 
 
 
10194ad
 
 
 
 
 
 
 
 
 
 
 
7a28690
d3826b7
8bfde36
b457626
f8b4ccb
d3826b7
f8b4ccb
d3826b7
 
 
 
b457626
 
d3826b7
 
 
f8b4ccb
d3826b7
 
 
 
 
b457626
d3826b7
b457626
f8b4ccb
d3826b7
f8b4ccb
d3826b7
7a28690
8bfde36
 
 
 
 
d3826b7
e5c750a
 
8bfde36
 
d3826b7
 
 
 
 
 
 
7a28690
72de156
 
 
 
 
 
 
 
 
 
 
7a28690
 
 
d3826b7
 
7a28690
d3826b7
 
 
7a28690
 
 
d3826b7
 
 
 
52ba7c6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d3826b7
 
b457626
d3826b7
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
---
license: apache-2.0
library_name: direct
tags:
  - mri
  - reconstruction
  - vsharp
  - fastmri
  - cmrxrecon
pipeline_tag: image-to-image
---

# DIRECT — vSHARP multi-anatomy

Pretrained [vSHARP](https://arxiv.org/abs/2309.09954) models for multi-coil MRI reconstruction. Each release is an inference-ready pair:

```text
vsharp_<name>.yaml   # inference-only DIRECT config
vsharp_<name>.pt     # weights
```

Paper: [arXiv:2309.09954](https://arxiv.org/abs/2309.09954) · Framework: [DIRECT](https://github.com/NKI-AI/direct)

## Datasets & provenance

Official portals (accept each dataset’s Data Sharing Agreement where required):

| Model | Official source | Notes |
|-------|-----------------|-------|
| `vsharp_brain` | [fastMRI brain](https://fastmri.med.nyu.edu/) (multi-coil Cartesian) | Same portal as knee; original challenge data / papers via NYU FAIR fastMRI. |
| `vsharp_knee` | [fastMRI knee](https://fastmri.med.nyu.edu/) (multi-coil Cartesian) | Fully sampled multi-coil knee MRI ([Zbontar et al.](https://arxiv.org/abs/1811.08839)). |
| `vsharp_prostate` | [fastMRI prostate](https://fastmri.med.nyu.edu/) · [Sci Data](https://www.nature.com/articles/s41597-024-03252-w) · [code](https://github.com/cai2r/fastMRI_prostate) | T2 multi-coil. Raw volumes are `(averages, slices, coils, readout, phase)` with **three averages at GRAPPA R=2** (odd/even line interleaving across averages). For these models, each average was **GRAPPA-reconstructed**, then the averages were **combined into a single fully sampled multi-coil volume** `(slices, coils, readout, phase)` using the official T2 GRAPPA pipeline ([`prostate_t2_recon.py`](https://github.com/cai2r/fastMRI_prostate/blob/main/fastmri_prostate/reconstruction/t2/prostate_t2_recon.py)). |
| `vsharp_breast` | [fastMRI breast](https://fastmri.med.nyu.edu/) · [Radiol AI](https://pubs.rsna.org/doi/10.1148/ryai.240345) · [code](https://github.com/eddysolo/demo_dce_recon) | Native acquisition is **radial GRASP DCE**. For these models, radial k-space was **regridded to Cartesian** multi-coil volumes before training / inference with DIRECT. |
| `vsharp_cardiac` | [CMRxRecon](https://cmrxrecon.github.io/) 2023 cine · Synapse [`syn51471091`](https://www.synapse.org/#!Synapse:syn51471091) · [Sci Data](https://doi.org/10.1038/s41597-024-03525-4) | Multi-coil cine cardiac MRI from the 2023 challenge release. |
| `vsharp_universal` | fastMRI brain/knee/prostate/breast + CMRxRecon **2023 / 2024 / 2025** | Same preprocessing as the anatomy-specific models above. CMRxRecon hub: [cmrxrecon.github.io](https://cmrxrecon.github.io/); Synapse portals for later challenges are linked from that site. |

## Training protocol

These models were **not** trained at a single fixed acceleration or scheme. All used the same mixed schedule:

| | Values |
|---|---|
| Accelerations \(R\) | `2, 4, 6, 8, 10` |
| Center fractions (ACS) | `0.16, 0.08, 0.06, 0.04, 0.02` (paired with \(R\): 2→0.16, 4→0.08, 6→0.06, 8→0.04, 10→0.02) |
| Sampling schemes | FastMRIEquispaced, FastMRIRandom, Gaussian1D, Gaussian2D, VariableDensityPoisson, Radial |

`vsharp_universal` was trained jointly across the anatomies / challenges above; anatomy-specific models were trained on one dataset each.

## Files & default inference masks

Released YAMLs are **inference-only** (no `training` / `validation` blocks). Each pins **one** acceleration and **one** ACS fraction — DIRECT’s mask sampler draws randomly from lists, so multi-\(R\) lists belong in training only.

| File pair | Default mask | Default \(R\) / ACS |
|-----------|--------------|---------------------|
| `vsharp_brain.{yaml,pt}` | FastMRIRandom | 4× / 0.08 |
| `vsharp_knee.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
| `vsharp_prostate.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
| `vsharp_breast.{yaml,pt}` | Radial | 4× / 0.08 |
| `vsharp_cardiac.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |
| `vsharp_universal.{yaml,pt}` | FastMRIEquispaced | 4× / 0.08 |

## Changing acceleration or scheme

Edit `inference.dataset.transforms.masking` and keep **both lists length 1**:

```yaml
inference:
  dataset:
    transforms:
      masking:
        name: FastMRIEquispaced   # any training scheme above
        accelerations: [8]        # single R
        center_fractions: [0.04]  # matching ACS
```

| Target \(R\) | `accelerations` | `center_fractions` |
|-------------|-----------------|--------------------|
| 2× | `[2]` | `[0.16]` |
| 4× | `[4]` | `[0.08]` |
| 6× | `[6]` | `[0.06]` |
| 8× | `[8]` | `[0.04]` |
| 10× | `[10]` | `[0.02]` |

## Install DIRECT

```bash
git clone https://github.com/NKI-AI/direct.git
cd direct
conda create --name direct python=3.12
conda activate direct
pip install meson-python meson ninja
pip install --no-build-isolation -e ".[dev]"
```

## Usage

```bash
hf download NKI-AI/direct-vsharp-multianatomy --local-dir ./vsharp_multianatomy

direct predict ./predictions \
  --cfg ./vsharp_multianatomy/vsharp_knee.yaml \
  --checkpoint ./vsharp_multianatomy/vsharp_knee.pt \
  --data-root /path/to/fastmri/knee/multicoil_val \
  --num-gpus 1
```

The first argument is the **prediction output directory**.

## Citation

If you use these models or [DIRECT](https://github.com/NKI-AI/direct), please cite the DIRECT toolkit and the method paper(s) below.

### DIRECT

```bibtex
@article{DIRECTTOOLKIT,
  title={DIRECT: Deep Image REConstruction Toolkit},
  author={Yiasemis, George and Moriakov, Nikita and Karkalousos, Dimitrios and Caan, Matthan and Teuwen, Jonas},
  journal={Journal of Open Source Software},
  volume={7},
  number={73},
  pages={4278},
  year={2022},
  doi={10.21105/joss.04278},
  url={https://doi.org/10.21105/joss.04278}
}
```

### Method

```bibtex
@article{yiasemis2024vsharp,
  title={vSHARP: variable Splitting Half-quadratic {ADMM} algorithm for Reconstruction of inverse Problems},
  author={Yiasemis, George and Moriakov, Nikita and S{\'a}nchez, Clara I. and Sonke, Jan-Jakob and Teuwen, Jonas},
  journal={Magnetic Resonance Materials in Physics, Biology and Medicine},
  year={2024},
  doi={10.1007/s10334-024-01189-0}
}
```