Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,3 +1,30 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: text-to-image
4
+ ---
5
+
6
+ # FiMR: Enhanced Text-to-Image Generation by Fine-grained Multimodal Reasoning
7
+
8
+ **FiMR** (Fine-grained Multimodal Reasoning) is a framework that enhances text-to-image generation in unified Multimodal Large Language Models (MLLMs). It leverages decomposed visual question answering (VQA) to break down an input prompt into minimal semantic units—such as entities and attributes—and verifies each unit to generate explicit, fine-grained feedback for targeted image refinement.
9
+
10
+ [**Paper**](https://arxiv.org/abs/2604.13491) | [**Code**](https://github.com/KU-AGI/FiMR)
11
+
12
+ ## Overview
13
+ Existing multimodal reasoning-based image generation methods often rely on holistic image-text alignment judgments. FiMR improves upon this by using decomposed VQA to verify detailed prompt attributes. This fine-grained self-reasoning and self-refinement enable MLLMs to achieve more precise improvements in image-prompt alignment and overall generation quality at test time.
14
+
15
+ ## Citation
16
+
17
+ ```bibtex
18
+ @misc{kim2026enhancedtexttoimagegenerationfinegrained,
19
+ title={Enhanced Text-to-Image Generation by Fine-grained Multimodal Reasoning},
20
+ author={Yongjin Kim and Yoonjin Oh and Yerin Kim and Hyomin Kim and Jeeyoung Yun and Yujung Heo and Minjun Kim and Sungwoong Kim},
21
+ year={2026},
22
+ eprint={2604.13491},
23
+ archivePrefix={arXiv},
24
+ primaryClass={cs.CV},
25
+ url={https://arxiv.org/abs/2604.13491},
26
+ }
27
+ ```
28
+
29
+ ## Acknowledgement
30
+ The authors thank the developers of [Janus-Series](https://github.com/deepseek-ai/janus) and [Janus-Pro-R1](https://github.com/wendell0218/Janus-Pro-R1) for making their models and code publicly available.