File size: 1,373 Bytes
585e9cc 6d08dd1 11ef389 6d08dd1 11ef389 6d08dd1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
license: apache-2.0
datasets:
- foreverbeliever/OmniMedVQA
language:
- en
metrics:
- accuracy
base_model:
- Qwen/Qwen2-VL-2B-Instruct
pipeline_tag: visual-question-answering
---
# Med-R1
Med-R1 is a reinforcement learning (RL)-enhanced vision-language model (VLM) designed for medical reasoning across 8 imaging modalities (CT, MRI, Ultrasound, Dermoscopy, Fundus Photography, Optical Coherence Tomography (OCT), Microscopy, and X-ray) and 5 key tasks (modality recognition, anatomy identification, disease diagnosis, lesion grading, and biological attribute analysis). Using Group Relative Policy Optimization (GRPO), Med-R1 improves generalization and trustworthiness, surpassing Qwen2-VL-2B by 29.94% and even outperforming the much larger Qwen2-VL-72B. Our model checkpoints provide researchers with a powerful tool for advancing medical AI with RL-driven enhancements.
## Description of Models
- **Cross-Modality**: We provide checkpoints trained separately on the following modalities:
- **CT**, **MRI**, **X-Ray**, **Fundus (FP)**, **Dermoscopy (Der)**, **Microscopy (Micro)**, **OCT**, and **Ultrasound (US)**.
- **Cross-Task Learning**: We provide checkpoints trained separately on the following tasks:
- **Anatomy Identification**, **Disease Diagnosis**, **Lesion Grading**, **Modality Recognition**, and **Biological Attribute Analysis**.
## Citation |