Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,43 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- brain-tumor-segmentation
|
| 5 |
+
- radiology-report-generation
|
| 6 |
+
- brats2020
|
| 7 |
+
- medical-imaging
|
| 8 |
+
- text-guided-segmentation
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# TextBraTS-arch3: Lightweight 2.5D Text-Guided Brain Tumor Segmentation
|
| 12 |
+
|
| 13 |
+
A lightweight 2.5D convolutional network for brain tumor segmentation + radiology report generation on the TextBraTS/BraTS2020 dataset.
|
| 14 |
+
|
| 15 |
+
## Results (93-patient official test set)
|
| 16 |
+
|
| 17 |
+
| Metric | Value |
|
| 18 |
+
|---|---|
|
| 19 |
+
| Avg Dice | 83.8% |
|
| 20 |
+
| Avg HD95 | 3.41 mm |
|
| 21 |
+
| ET Dice | 79.7 |
|
| 22 |
+
| WT Dice | 89.5 |
|
| 23 |
+
| TC Dice | 82.3 |
|
| 24 |
+
|
| 25 |
+
Beats TextCSP SOTA (4.81mm) and TextBraTS (5.13mm) on HD95 at **10.4M parameters**.
|
| 26 |
+
|
| 27 |
+
## Repo structure
|
| 28 |
+
|
| 29 |
+
- `segmentation/best_avg.pt` — segmentation model checkpoint (epoch 64, val-selected)
|
| 30 |
+
- `t5/model.safetensors` + tokenizer — fine-tuned T5-small report generation head
|
| 31 |
+
- `t5/img_proj.pt` — image-conditioned projection weights for T5
|
| 32 |
+
|
| 33 |
+
## Architecture
|
| 34 |
+
|
| 35 |
+
- **Input:** 2.5D — 4 MRI modalities × 3 adjacent axial slices = 12 channels at 128×128
|
| 36 |
+
- **Encoder:** 4-stage ResNet (32→64→128→256 ch)
|
| 37 |
+
- **Text:** Offline RadBERT embeddings (zero forward-pass text cost)
|
| 38 |
+
- **Decoder:** Attention-gated skips + soft cascade WT→TC→ET
|
| 39 |
+
- **Report gen:** ImageConditionedT5-small (8 image-prefix soft tokens)
|
| 40 |
+
|
| 41 |
+
## Dataset
|
| 42 |
+
|
| 43 |
+
TextBraTS / BraTS2020 — official split: 220 train / 56 val / 93 test
|