Add model card and metadata
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,30 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
--
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: text-to-image
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
# FiMR: Enhanced Text-to-Image Generation by Fine-grained Multimodal Reasoning
|
| 7 |
+
|
| 8 |
+
**FiMR** (Fine-grained Multimodal Reasoning) is a framework that enhances text-to-image generation in unified Multimodal Large Language Models (MLLMs). It leverages decomposed visual question answering (VQA) to break down an input prompt into minimal semantic units—such as entities and attributes—and verifies each unit to generate explicit, fine-grained feedback for targeted image refinement.
|
| 9 |
+
|
| 10 |
+
[**Paper**](https://arxiv.org/abs/2604.13491) | [**Code**](https://github.com/KU-AGI/FiMR)
|
| 11 |
+
|
| 12 |
+
## Overview
|
| 13 |
+
Existing multimodal reasoning-based image generation methods often rely on holistic image-text alignment judgments. FiMR improves upon this by using decomposed VQA to verify detailed prompt attributes. This fine-grained self-reasoning and self-refinement enable MLLMs to achieve more precise improvements in image-prompt alignment and overall generation quality at test time.
|
| 14 |
+
|
| 15 |
+
## Citation
|
| 16 |
+
|
| 17 |
+
```bibtex
|
| 18 |
+
@misc{kim2026enhancedtexttoimagegenerationfinegrained,
|
| 19 |
+
title={Enhanced Text-to-Image Generation by Fine-grained Multimodal Reasoning},
|
| 20 |
+
author={Yongjin Kim and Yoonjin Oh and Yerin Kim and Hyomin Kim and Jeeyoung Yun and Yujung Heo and Minjun Kim and Sungwoong Kim},
|
| 21 |
+
year={2026},
|
| 22 |
+
eprint={2604.13491},
|
| 23 |
+
archivePrefix={arXiv},
|
| 24 |
+
primaryClass={cs.CV},
|
| 25 |
+
url={https://arxiv.org/abs/2604.13491},
|
| 26 |
+
}
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
## Acknowledgement
|
| 30 |
+
The authors thank the developers of [Janus-Series](https://github.com/deepseek-ai/janus) and [Janus-Pro-R1](https://github.com/wendell0218/Janus-Pro-R1) for making their models and code publicly available.
|