Add model card for Light-UNETR

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: image-segmentation
4
+ tags:
5
+ - medical
6
+ - 3d
7
+ - transformer
8
+ ---
9
+
10
+ # Light-UNETR
11
+
12
+ Light-UNETR is a lightweight transformer architecture designed for efficient 3D medical image segmentation, introduced in the paper [Harnessing Lightweight Transformer with Contextual Synergic Enhancement for Efficient 3D Medical Image Segmentation](https://huggingface.co/papers/2603.23390).
13
+
14
+ The model addresses computational efficiency through a Lightweight Dimension Reductive Attention (LIDR) module and a Compact Gated Linear Unit (CGLU). To improve data efficiency, the authors propose a Contextual Synergic Enhancement (CSE) learning strategy.
15
+
16
+ ## Resources
17
+
18
+ - **Paper:** [Harnessing Lightweight Transformer with Contextual Synergic Enhancement for Efficient 3D Medical Image Segmentation](https://huggingface.co/papers/2603.23390)
19
+ - **Code:** [Official GitHub Repository](https://github.com/CUHK-AIM-Group/Light-UNETR)
20
+
21
+ ## Performance
22
+
23
+ Light-UNETR significantly reduces computational costs compared to standard architectures. For instance, on the Left Atrial (LA) Segmentation dataset, it reduces FLOPs by 90.8% and parameters by 85.8% compared to state-of-the-art methods while achieving superior performance even with limited (10%) labeled data.
24
+
25
+ ## Sample Usage
26
+
27
+ To test a pre-trained Light-UNETR model using the official implementation, you can use the following command structure:
28
+
29
+ ```bash
30
+ # Example: Test BraTS model
31
+ python test_cse.py --dataset brats --model lightunetr --checkpoint lightunetr_best_model_brats_25lab.pth --gpu 0
32
+ ```
33
+
34
+ ## Citation
35
+
36
+ If you find this work useful, please cite:
37
+
38
+ ```bibtex
39
+ @article{liu2025harnessing,
40
+ title={Harnessing Lightweight Transformer with Contextual Synergic Enhancement for Efficient 3D Medical Image Segmentation},
41
+ author={Liu, Xinyu and Chen, Zhen and Li, Wuyang and Li, Chenxin and Yuan, Yixuan},
42
+ year={2025}
43
+ }
44
+ ```
45
+
46
+ ## Acknowledgement
47
+
48
+ The authors appreciate the contributions of [SSL4MIS](https://github.com/HiLab-git/SSL4MIS), [Slim UNETR](https://github.com/aigzhusmart/Slim-UNETR), [BCP](https://github.com/DeepMed-Lab-ECNU/BCP), and other referenced codebases.