| --- |
| license: cc-by-nc-sa-4.0 |
| language: |
| - en |
| tags: |
| - vision-language pretraining |
| - medical |
| - ct diagnosis |
| --- |
| |
| # RADAR: An Expert-Level Generalist AI for Abdominal CT Diagnosis |
| [](https://github.com/alibaba-damo-academy/damo-radar) |
| [](https://zenodo.org/records/21271172) |
| [](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
|
|
| RADAR is a generalist vision-language model trained on over 400,000 contrast-enhanced abdominal CT examinations with 15 million anatomy-aware image–text pairs, learning directly from clinical reports without manual annotation. RADAR provides a scalable and versatile framework for radiology AI, demonstrating expert-level performance across both routine and complex clinical tasks. |
|
|
| <p align="center"> |
| <img src="radar_fig0.png" alt="RADAR Overview" width="90%"> |
| </p> |
|
|
| ## Model Preparation |
|
|
| Pre-trained checkpoints are available on [HuggingFace](https://huggingface.co/datasets/radar-generalist/RADAR). |
|
|
| | File | Description | Destination | |
| | --- | --- | --- | |
| | `checkpoint_radar_pretrain.pth` | RADAR pre-trained on RAD-CT | `radar/ckpt/checkpoint_radar_pretrain.pth` | |
| | `bert-base-chinese` | BERT tokenizer and model (Chinese) | `radar/ckpt/bert-base-chinese/` | |
| | `bert-base-uncased` | BERT tokenizer and model (English) | `radar/ckpt/bert-base-uncased/` | |
| | `checkpoint_unet.pth` | Pretrained VisionBranch (UNet) checkpoint | `radar/ckpt/checkpoint_unet.pth` | |
| | `checkpoint_radar_plus.pth` | RADAR+ checkpoint trained from scratch on Merlin-CT-Train | `radar/ckpt/checkpoint_radar_plus.pth` | |
| | `checkpoint_radar_plus_finetuned_on_merlin.pth` | RADAR+ checkpoint pretrained on RAD-CT and finetuned on Merlin-CT-Train | `radar/ckpt/checkpoint_radar_plus_finetuned_on_merlin.pth` | |
|
|