README.md

---
license: mit
language:
- en
tags:
- 3d
- medical
- image-synthesis
- image-generation
- wavelet-transform
arxiv: 2402.19043
---

# WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis
This is the officical model repository of the paper "[**WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis**](https://pfriedri.github.io/wdm-3d-io)" by Paul Friedrich, Julia Wolleb, Florentin Bieder, Alicia Durrer and Philippe C. Cattin.

**WDM** is a wavelet-based medical image synthesis framework that can generate high-resolution medical images like CT or MR scans.
For more information on our method, we refer to our [**project page**](https://pfriedri.github.io/wdm-3d-io) or the [**paper**](https://arxiv.org/abs/2402.19043).

## Origial GitHub repository
If you want to use the pre-trained models provided in this repository, download the model weights and follow the instructions in the official [GitHub repository](https://github.com/pfriedri/wdm-3d).

## Pre-trained models
### BraTS 2023 (T1-weighted brain MR image generation)
- [Download model](brats_unet_128_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations

### LIDC-IDRI (Lung CT image generation)
- [Download model](lidc-idri_128_unet_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations

## Hardware requirements
To sample images from the provided models, you require a GPU with at least:
- 3 GB VRAM - for 128 x 128 x 128 (model uses ~2.55 GB)
- 8 GB VRAM - for 256 x 256 x 256 (model uses ~7.27 GB)

The models were trained on a system with an an AMD Epyc 7742 CPU and a NVIDIA A100 (40GB) GPU.

## Citation
If you find this work useful, please cite:
```bibtex
@article{friedrich2024wdm,
         title={WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis},
         author={Paul Friedrich and Julia Wolleb and Florentin Bieder and Alicia Durrer and Philippe C. Cattin},
         year={2024},
         journal={arXiv preprint arXiv:2402.19043}}
```