You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Please provide your affiliation and intended use to apply for access.

Log in or Sign Up to review the conditions and access this model content.

Model weights

Weights are published on Hugging Face: TaipingQu/BAAI-Cardiac-Agent. Extract them under the project root as weights/, consistent with expert_weight_path in app.config.

  • Agent: A LLaVA multimodal model (LLaMA backbone + vision encoder), fine-tuned for cardiac MRI. Files follow the Hugging Face layout under weights/agent/.
  • Expert models: Task-specific PyTorch .pth checkpoints—multi-stage segmentation for Cine 2CH / 4CH / short-axis and LGE short-axis, plus CDS (cardiac disease screening) and NICMS (non-ischemic cardiomyopathy subtyping) classifiers in per-task subfolders under weights/.

Checkpoints and layout

Subdirectory Checkpoint Model Task
/ (Hugging Face layout) LLaVA Multimodal agent
cine_seg_first_2CH/ Cine_2CH_seg1.pth Segmentation stage 1 Cine 2-chamber coarse
cine_seg_second_2CH/ Cine_2CH_seg2.pth Segmentation stage 2 Cine 2-chamber refined
cine_seg_first_4CH/ Cine_4CH_seg1.pth Segmentation stage 1 Cine 4-chamber coarse
cine_seg_second_4CH_L/ Cine_4CH_seg2_L.pth Segmentation stage 2 (left) Cine 4-chamber L refinement
cine_seg_second_4CH_R/ Cine_4CH_seg2_R.pth Segmentation stage 2 (right) Cine 4-chamber R refinement
cine_seg_first_SA/ Cine_SAX_seg1.pth Segmentation stage 1 Cine short-axis coarse
cine_seg_second_SA/ Cine_SAX_seg2.pth Segmentation stage 2 Cine short-axis refined
lge_seg_first_SA/ LGE_SAX_seg1.pth Segmentation stage 1 LGE short-axis coarse
lge_seg_second_SA/ LGE_SAX_seg2.pth Segmentation stage 2 LGE short-axis refined
diagnosis_first/ CDS.pth Classification Cardiac disease screening (CDS)
diagnosis_second/ NICMS.pth Classification NICMS subtyping

Citation

If you find our work useful in your research or application, please consider citing our paper:

Downloads last month
11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support