Add pipeline tag and link to paper

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +16 -7
README.md CHANGED
@@ -1,15 +1,24 @@
1
  ---
2
- license: apache-2.0
3
- library_name: peft
4
- tags: [medical, radiology, vqa, medical-imaging, lora, diffusion-llm]
5
  base_model:
6
- - google/diffusiongemma-26B-A4B-it
7
- - google/gemma-4-26B-A4B-it
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  # DiffusionGemma finetunes for radiology VQA
11
 
12
- LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM) for radiology visual question answering, each paired with an **autoregressive Gemma-4** finetune as a controlled baseline. Mixed modalities/anatomy (VQA-RAD, SLAKE, VQA-Med: X-ray/CT/MRI, head/chest/abdomen). Judge-best checkpoint per cell.
 
 
13
 
14
  **Code:** https://github.com/mxvp/discrete_diffusion_RRG
15
 
@@ -20,4 +29,4 @@ LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM)
20
  | diffusion-slake | discrete-diffusion | google/diffusiongemma-26B-A4B-it | SLAKE | 0.863 |
21
  | ar-slake | autoregressive | google/gemma-4-26B-A4B-it | SLAKE | 0.817 |
22
  | diffusion-vqamed | discrete-diffusion | google/diffusiongemma-26B-A4B-it | VQA-Med | 0.666 |
23
- | ar-vqamed | autoregressive | google/gemma-4-26B-A4B-it | VQA-Med | 0.631 |
 
1
  ---
 
 
 
2
  base_model:
3
+ - google/diffusiongemma-26B-A4B-it
4
+ - google/gemma-4-26B-A4B-it
5
+ library_name: peft
6
+ license: apache-2.0
7
+ pipeline_tag: image-text-to-text
8
+ tags:
9
+ - medical
10
+ - radiology
11
+ - vqa
12
+ - medical-imaging
13
+ - lora
14
+ - diffusion-llm
15
  ---
16
 
17
  # DiffusionGemma finetunes for radiology VQA
18
 
19
+ This repository contains LoRA finetunes of **DiffusionGemma** (image-conditioned discrete-diffusion LLM) for radiology visual question answering, each paired with an **autoregressive Gemma-4** finetune as a controlled baseline. It corresponds to the paper [Discrete Diffusion Language Models for Interactive Radiology Report Drafting](https://huggingface.co/papers/2607.01436).
20
+
21
+ The dataset covers mixed modalities/anatomy (VQA-RAD, SLAKE, VQA-Med: X-ray/CT/MRI, head/chest/abdomen). Judge-best checkpoint per cell.
22
 
23
  **Code:** https://github.com/mxvp/discrete_diffusion_RRG
24
 
 
29
  | diffusion-slake | discrete-diffusion | google/diffusiongemma-26B-A4B-it | SLAKE | 0.863 |
30
  | ar-slake | autoregressive | google/gemma-4-26B-A4B-it | SLAKE | 0.817 |
31
  | diffusion-vqamed | discrete-diffusion | google/diffusiongemma-26B-A4B-it | VQA-Med | 0.666 |
32
+ | ar-vqamed | autoregressive | google/gemma-4-26B-A4B-it | VQA-Med | 0.631 |