Instructions to use gevaertlab/diffusiongemma-radiology-vqa with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use gevaertlab/diffusiongemma-radiology-vqa with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Add pipeline tag and link to paper
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,15 +1,24 @@
|
|
| 1 |
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
library_name: peft
|
| 4 |
-
tags: [medical, radiology, vqa, medical-imaging, lora, diffusion-llm]
|
| 5 |
base_model:
|
| 6 |
-
|
| 7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
# DiffusionGemma finetunes for radiology VQA
|
| 11 |
|
| 12 |
-
LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM) for radiology visual question answering, each paired with an **autoregressive Gemma-4** finetune as a controlled baseline.
|
|
|
|
|
|
|
| 13 |
|
| 14 |
**Code:** https://github.com/mxvp/discrete_diffusion_RRG
|
| 15 |
|
|
@@ -20,4 +29,4 @@ LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM)
|
|
| 20 |
| diffusion-slake | discrete-diffusion | google/diffusiongemma-26B-A4B-it | SLAKE | 0.863 |
|
| 21 |
| ar-slake | autoregressive | google/gemma-4-26B-A4B-it | SLAKE | 0.817 |
|
| 22 |
| diffusion-vqamed | discrete-diffusion | google/diffusiongemma-26B-A4B-it | VQA-Med | 0.666 |
|
| 23 |
-
| ar-vqamed | autoregressive | google/gemma-4-26B-A4B-it | VQA-Med | 0.631 |
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
| 2 |
base_model:
|
| 3 |
+
- google/diffusiongemma-26B-A4B-it
|
| 4 |
+
- google/gemma-4-26B-A4B-it
|
| 5 |
+
library_name: peft
|
| 6 |
+
license: apache-2.0
|
| 7 |
+
pipeline_tag: image-text-to-text
|
| 8 |
+
tags:
|
| 9 |
+
- medical
|
| 10 |
+
- radiology
|
| 11 |
+
- vqa
|
| 12 |
+
- medical-imaging
|
| 13 |
+
- lora
|
| 14 |
+
- diffusion-llm
|
| 15 |
---
|
| 16 |
|
| 17 |
# DiffusionGemma finetunes for radiology VQA
|
| 18 |
|
| 19 |
+
This repository contains LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM) for radiology visual question answering, each paired with an **autoregressive Gemma-4** finetune as a controlled baseline. It corresponds to the paper [Discrete Diffusion Language Models for Interactive Radiology Report Drafting](https://huggingface.co/papers/2607.01436).
|
| 20 |
+
|
| 21 |
+
The dataset covers mixed modalities/anatomy (VQA-RAD, SLAKE, VQA-Med: X-ray/CT/MRI, head/chest/abdomen). Judge-best checkpoint per cell.
|
| 22 |
|
| 23 |
**Code:** https://github.com/mxvp/discrete_diffusion_RRG
|
| 24 |
|
|
|
|
| 29 |
| diffusion-slake | discrete-diffusion | google/diffusiongemma-26B-A4B-it | SLAKE | 0.863 |
|
| 30 |
| ar-slake | autoregressive | google/gemma-4-26B-A4B-it | SLAKE | 0.817 |
|
| 31 |
| diffusion-vqamed | discrete-diffusion | google/diffusiongemma-26B-A4B-it | VQA-Med | 0.666 |
|
| 32 |
+
| ar-vqamed | autoregressive | google/gemma-4-26B-A4B-it | VQA-Med | 0.631 |
|