Update README.md
Browse files
README.md
CHANGED
|
@@ -8,44 +8,8 @@ tags:
|
|
| 8 |
- 3d-medical-imaging
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# 3D Medical Diffusion VQ-AE Checkpoint
|
| 12 |
-
|
| 13 |
-
This is the pretrained VQ-AE (Vector Quantized Autoencoder) checkpoint from [3D-MedDiffusion](https://github.com/DiffusionMRI/3D-MedDiffusion).
|
| 14 |
-
|
| 15 |
-
## Model Details
|
| 16 |
-
|
| 17 |
-
- **Architecture**: PatchVolume 8× compression with stage 2 training
|
| 18 |
-
- **Compression Factor**: 8× spatial (per dimension)
|
| 19 |
-
- **Latent Channels**: 8
|
| 20 |
-
- **Codebook Size**: 8192 vectors
|
| 21 |
-
- **Input**: CT volumes [B, 1, D, H, W] normalized to [-1, 1]
|
| 22 |
-
- **Output**: Latent embeddings [B, 8, D/8, H/8, W/8]
|
| 23 |
-
|
| 24 |
-
## Usage
|
| 25 |
-
|
| 26 |
-
```python
|
| 27 |
-
from models.vqae_wrapper import FrozenVQAE
|
| 28 |
-
|
| 29 |
-
# Load from HuggingFace Hub
|
| 30 |
-
vae = FrozenVQAE(
|
| 31 |
-
checkpoint_path="hf://t2ance/ct-vqae-checkpoint/PatchVolume_8x_s2.ckpt",
|
| 32 |
-
device='cuda'
|
| 33 |
-
)
|
| 34 |
-
|
| 35 |
-
# Encode CT volume
|
| 36 |
-
ct = torch.randn(1, 1, 200, 128, 128).cuda()
|
| 37 |
-
z = vae.encode(ct) # [1, 8, 25, 16, 16]
|
| 38 |
-
|
| 39 |
-
# Decode back
|
| 40 |
-
ct_recon = vae.decode(z) # [1, 1, 200, 128, 128]
|
| 41 |
-
```
|
| 42 |
-
|
| 43 |
## Original Source
|
| 44 |
|
| 45 |
-
This checkpoint is from the 3D-MedDiffusion project:
|
| 46 |
-
-
|
| 47 |
-
- Code: https://github.com/DiffusionMRI/3D-MedDiffusion
|
| 48 |
-
|
| 49 |
-
## License
|
| 50 |
|
| 51 |
-
Apache 2.0 (same as original 3D-MedDiffusion project)
|
|
|
|
| 8 |
- 3d-medical-imaging
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
## Original Source
|
| 12 |
|
| 13 |
+
This checkpoint is a direct copy from the 3D-MedDiffusion project:
|
| 14 |
+
- https://github.com/ShanghaiTech-IMPACT/3D-MedDiffusion
|
|
|
|
|
|
|
|
|
|
| 15 |
|
|
|