Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,21 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+assets/microscopy_qualitative.png filter=lfs diff=lfs merge=lfs -text
+assets/reward_design_graph.png filter=lfs diff=lfs merge=lfs -text
+assets/medix-r1_arch.png filter=lfs diff=lfs merge=lfs -text
+assets/xray_qualitative.png filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-F16.gguf filter=lfs diff=lfs merge=lfs -text
+MediX-R1-2B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mmproj-MediX-R1-2b-F16.gguf filter=lfs diff=lfs merge=lfs -text

MediX-R1-2B-F16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c1fd8601373db80a1a0895a5e579f18ec80aaaff441bbf3141133c31106283a
+size 4069680320

MediX-R1-2B-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:acc0531b0b2f3a23d7db0a540ad4afbe9849954007db6e80b62c2329b611d9bd
+size 1234172864

MediX-R1-2B-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77be100522adc6ac69f018ed9a6f4d21b7fc4f93d073297b5a736467d53a720f
+size 1181588416

MediX-R1-2B-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:abcdff17219e01b852d05e5498be7d4dc6256dd902beb83d9b83df632a9b6118
+size 1229454272

MediX-R1-2B-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce91584e5ae2ddf50f779173fa19ff7d255a85765a05d3c093304e0dd71ed60f
+size 1336982464

MediX-R1-2B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfd8181092ec3809ceaa9a8939c39831f28393dd4d9fea2477759828955b19ab
+size 1282440128

MediX-R1-2B-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26308cdc7ec14b19d273a23233fdf44a9bb1ff76f4e4d4bd42e941376814085b
+size 1235221440

MediX-R1-2B-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c1cc054c2351899d80ec345c980498a29f7af3f3b0854abd6e5abedbbd3e45d7
+size 1444510656

MediX-R1-2B-Q5_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e75d7ed4af540ffaeb5e859c6280abd6f0c74d212658b2c9b6d47120ee1991bc
+size 1552038848

MediX-R1-2B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ac7cdcbac14d63244d25ff6c6006be01ffc37abcaf1a94ecd5daf7fecb235ab
+size 1471806400

MediX-R1-2B-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:182b00e3a41cacd5702649036fdaf081e90998d29c8cfd72840073cba08819e0
+size 1444510656

MediX-R1-2B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3791ffb70acf0bf907d8957489fc36fb2b35187e0dc687a1943737645b7c049d
+size 1673008064

MediX-R1-2B-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2078f743aebc10fe4f891f032eaabac37d4a230b97ee0b9c3e29c9eb209169b0
+size 2165040064

README.md

@@ -0,0 +1,159 @@
+---
+license: cc-by-nc-sa-4.0
+language:
+  - en
+tags:
+  - medical
+  - reinforcement-learning
+  - multimodal
+  - vision-language
+  - qwen3-vl
+pipeline_tag: image-text-to-text
+library_name: transformers
+---
+# MediX-R1: Open-Ended Medical Reinforcement Learning
+
+<p align="center">
+    <img src="assets/logo_white_no_bg.png" alt="MediX-R1" width="200">
+</p>
+
+<p align="center">
+    <img src="https://i.imgur.com/waxVImv.png" alt="MediX-R1">
+</p>
+
+#### [Sahal Shaji Mullappilly](https://scholar.google.com/citations?user=LJWxVpUAAAAJ&hl=en)\*, [Mohammed Irfan K](https://scholar.google.com/citations?user=GJp0keYAAAAJ&hl=en)\*, [Omair Mohamed](https://scholar.google.com), [Mohamed Zidan](https://scholar.google.com), [Fahad Khan](https://sites.google.com/view/fahadkhans/home), [Salman Khan](https://salman-h-khan.github.io/), [Rao Muhammad Anwer](https://scholar.google.com/citations?hl=en&authuser=1&user=_KlvMVoAAAAJ), and [Hisham Cholakkal](https://scholar.google.com/citations?hl=en&user=bZ3YBRcAAAAJ)
+
+\**Equally contributing first authors*
+
+#### **Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI), UAE**
+
+[![Website](https://img.shields.io/badge/Project-Website-87CEEB)](https://medix.cvmbzuai.com)
+[![Paper](https://img.shields.io/badge/arXiv-Paper-red.svg)](https://arxiv.org/pdf/2602.23363)
+[![HuggingFace](https://img.shields.io/badge/HuggingFace-Page-F9D371)](https://huggingface.co/collections/MBZUAI/medix-r1)
+[![Leaderboard](https://img.shields.io/badge/MediX-Leaderboard-green)](https://medix.cvmbzuai.com/leaderboard)
+
+---
+
+## Overview
+
+MediX-R1 is an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes vision-language backbones with Group-Based RL and a composite reward tailored for medical reasoning: an LLM-based accuracy reward, a medical embedding-based semantic reward, and lightweight format and modality rewards that enforce interpretable reasoning.
+
+Despite using only ~50K instruction examples, MediX-R1 achieves excellent results across standard medical LLM and VLM benchmarks, outperforming strong open-source baselines.
+
+**Highlights:**
+- Our **8B** model achieves an overall average of **68.8%**, outperforming the much larger 27B MedGemma (68.4%).
+- Our **30B** model achieves the best overall score of **73.6%**, demonstrating the effectiveness of our composite reward design.
+
+---
+
+## Contributions
+
+- We introduce an **open-ended RL framework** for medical MLLMs that produces clinically grounded, free-form answers beyond MCQ formats.
+- We design a **composite reward** combining LLM-based accuracy, embedding-based semantic similarity, format adherence, and modality recognition, providing stable and informative feedback where traditional verifiable or MCQ-only rewards fall short.
+- We propose a **unified evaluation framework** for both text-only and image+text tasks using a Reference-based LLM-as-judge, capturing semantic correctness, reasoning, and contextual alignment.
+- Despite using only **~50K** instruction examples, MediX-R1 achieves state-of-the-art results across diverse medical LLM and VLM benchmarks, with particularly large gains on open-ended clinical tasks.
+
+---
+
+## Architecture
+
+<p align="center">
+  <img src="assets/medix-r1_arch.png" alt="MediX-R1 Architecture" width="100%">
+</p>
+
+---
+
+## Composite Reward Design
+
+MediX-R1 uses a multi-signal reward combining LLM-based accuracy, embedding-based semantic similarity, format adherence, and modality recognition. This stabilizes training and prevents reward hacking compared to single-signal approaches.
+
+<p align="center">
+  <img src="assets/reward_design_graph.png" alt="Reward Design" width="60%">
+</p>
+
+---
+
+## Qualitative Examples
+
+<p align="center">
+  <img src="assets/microscopy_qualitative.png" alt="Microscopy Example" width="85%">
+  <img src="assets/xray_qualitative.png" alt="X-ray Example" width="85%">
+</p>
+
+---
+
+## Training
+
+We provide training configs for all model sizes using GRPO and DAPO algorithms. The training pipeline uses a vLLM-based reward server for LLM-as-judge scoring during RL training.
+
+```bash
+cd training
+pip install -e .
+bash vllm_serve.sh       # Step 1: Start the reward server
+bash run_train.sh        # Step 2: Launch RL training
+bash merge_model.sh      # Step 3: Merge FSDP checkpoints
+```
+
+Training data: [MBZUAI/medix-rl-data](https://huggingface.co/datasets/MBZUAI/medix-rl-data) (~51K train, ~2.5K test samples)
+
+See [`training/README.md`](training/README.md) for detailed setup, configuration options, and per-model scripts.
+
+## Evaluation
+
+We propose a unified evaluation framework for both text-only (LLM) and image+text (VLM) tasks using a Reference-based LLM-as-judge across 17 medical benchmarks.
+
+```bash
+cd eval
+pip install uv && uv pip install -r requirements.txt
+bash eval.sh             # Run all phases: generate, evaluate, score
+```
+
+Supports self-hosted judge models via vLLM or [OpenRouter](https://openrouter.ai/) as a remote alternative. Results can be submitted to the [MediX Leaderboard](https://medix.cvmbzuai.com/leaderboard).
+
+See [`eval/README.md`](eval/README.md) for task selection, CLI reference, and MMMU-Medical evaluation.
+
+---
+
+## Model Zoo
+
+| Model | HuggingFace |
+|-------|-------------|
+| MediX-R1-2B | [MBZUAI/MediX-R1-2B](https://huggingface.co/MBZUAI/MediX-R1-2B) |
+| MediX-R1-8B | [MBZUAI/MediX-R1-8B](https://huggingface.co/MBZUAI/MediX-R1-8B) |
+| MediX-R1-30B | [MBZUAI/MediX-R1-30B](https://huggingface.co/MBZUAI/MediX-R1-30B) |
+
+---
+
+## Citation
+
+If you use MediX-R1 in your research, please cite our work as follows:
+
+```bibtex
+@misc{mullappilly2026medixr1openendedmedical,
+      title={MediX-R1: Open Ended Medical Reinforcement Learning}, 
+      author={Sahal Shaji Mullappilly and Mohammed Irfan Kurpath and Omair Mohamed and Mohamed Zidan and Fahad Khan and Salman Khan and Rao Anwer and Hisham Cholakkal},
+      year={2026},
+      eprint={2602.23363},
+      archivePrefix={arXiv},
+      primaryClass={cs.CV},
+      url={https://arxiv.org/abs/2602.23363}, 
+}
+```
+
+---
+
+## License
+
+This project is released for **research purposes only** under [*CC-BY-NC-SA 4.0*](https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode.en) License. It is not intended for clinical or commercial use.
+
+Users are urged to employ MediX-R1 responsibly, especially when applying its outputs in real-world medical scenarios. It is imperative to verify the model's advice with qualified healthcare professionals and not rely on it for medical diagnoses or treatment decisions.
+
+---
+
+## Acknowledgements
+
+We are thankful to [EasyR1](https://github.com/hiyouga/EasyR1) (a fork of [veRL](https://github.com/volcengine/verl)) for their open-source RL training framework.
+
+This work was partially supported with  *NVIDIA Academic Grant 2025* and *MBZUAI-IITD* Research Collaboration Seed Grant. 
+
+We are grateful to [MBZUAI](https://mbzuai.ac.ae/) for compute and support.

mmproj-MediX-R1-2b-F16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4cf5185efaea0016c1a3557fe32889cf994df6b98c24c831f7e09f6c775d247
+size 819394976