RADAR / README.md
changwx's picture
first upload
2bf227e verified
|
Raw
History Blame Contribute Delete
1.98 kB
---
license: cc-by-nc-sa-4.0
language:
- en
tags:
- vision-language pretraining
- medical
- ct diagnosis
---
# RADAR: An Expert-Level Generalist AI for Abdominal CT Diagnosis
[![GitHub](https://img.shields.io/badge/GitHub-Code-blue?logo=github)](https://github.com/alibaba-damo-academy/damo-radar)
[![Zenodo](https://img.shields.io/badge/Zenodo-Code-7B61FF?logo=zenodo&logoColor=white)](https://zenodo.org/records/21271172)
[![License: CC BY-NC-SA 4.0](https://img.shields.io/badge/License-CC_BY--NC--SA_4.0-lightgrey.svg)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
RADAR is a generalist vision-language model trained on over 400,000 contrast-enhanced abdominal CT examinations with 15 million anatomy-aware image–text pairs, learning directly from clinical reports without manual annotation. RADAR provides a scalable and versatile framework for radiology AI, demonstrating expert-level performance across both routine and complex clinical tasks.
<p align="center">
<img src="radar_fig0.png" alt="RADAR Overview" width="90%">
</p>
## Model Preparation
Pre-trained checkpoints are available on [HuggingFace](https://huggingface.co/datasets/radar-generalist/RADAR).
| File | Description | Destination |
| --- | --- | --- |
| `checkpoint_radar_pretrain.pth` | RADAR pre-trained on RAD-CT | `radar/ckpt/checkpoint_radar_pretrain.pth` |
| `bert-base-chinese` | BERT tokenizer and model (Chinese) | `radar/ckpt/bert-base-chinese/` |
| `bert-base-uncased` | BERT tokenizer and model (English) | `radar/ckpt/bert-base-uncased/` |
| `checkpoint_unet.pth` | Pretrained VisionBranch (UNet) checkpoint | `radar/ckpt/checkpoint_unet.pth` |
| `checkpoint_radar_plus.pth` | RADAR+ checkpoint trained from scratch on Merlin-CT-Train | `radar/ckpt/checkpoint_radar_plus.pth` |
| `checkpoint_radar_plus_finetuned_on_merlin.pth` | RADAR+ checkpoint pretrained on RAD-CT and finetuned on Merlin-CT-Train | `radar/ckpt/checkpoint_radar_plus_finetuned_on_merlin.pth` |