You need to agree to share your contact information to access this model
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
Please provide your affiliation and intended use to apply for access.
Log in or Sign Up to review the conditions and access this model content.
Model weights
Weights are published on Hugging Face: TaipingQu/BAAI-Cardiac-Agent. Extract them under the project root as weights/, consistent with expert_weight_path in app.config.
- Agent: A LLaVA multimodal model (LLaMA backbone + vision encoder), fine-tuned for cardiac MRI. Files follow the Hugging Face layout under
weights/agent/. - Expert models: Task-specific PyTorch
.pthcheckpoints—multi-stage segmentation for Cine 2CH / 4CH / short-axis and LGE short-axis, plus CDS (cardiac disease screening) and NICMS (non-ischemic cardiomyopathy subtyping) classifiers in per-task subfolders underweights/.
Checkpoints and layout
| Subdirectory | Checkpoint | Model | Task |
|---|---|---|---|
/ |
(Hugging Face layout) | LLaVA | Multimodal agent |
cine_seg_first_2CH/ |
Cine_2CH_seg1.pth |
Segmentation stage 1 | Cine 2-chamber coarse |
cine_seg_second_2CH/ |
Cine_2CH_seg2.pth |
Segmentation stage 2 | Cine 2-chamber refined |
cine_seg_first_4CH/ |
Cine_4CH_seg1.pth |
Segmentation stage 1 | Cine 4-chamber coarse |
cine_seg_second_4CH_L/ |
Cine_4CH_seg2_L.pth |
Segmentation stage 2 (left) | Cine 4-chamber L refinement |
cine_seg_second_4CH_R/ |
Cine_4CH_seg2_R.pth |
Segmentation stage 2 (right) | Cine 4-chamber R refinement |
cine_seg_first_SA/ |
Cine_SAX_seg1.pth |
Segmentation stage 1 | Cine short-axis coarse |
cine_seg_second_SA/ |
Cine_SAX_seg2.pth |
Segmentation stage 2 | Cine short-axis refined |
lge_seg_first_SA/ |
LGE_SAX_seg1.pth |
Segmentation stage 1 | LGE short-axis coarse |
lge_seg_second_SA/ |
LGE_SAX_seg2.pth |
Segmentation stage 2 | LGE short-axis refined |
diagnosis_first/ |
CDS.pth |
Classification | Cardiac disease screening (CDS) |
diagnosis_second/ |
NICMS.pth |
Classification | NICMS subtyping |
Citation
If you find our work useful in your research or application, please consider citing our paper:
- Downloads last month
- 11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support