Upload README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,151 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<div align="center">
|
| 2 |
+
<a href="https://arxiv.org/abs/2512.09271"><img src="https://img.shields.io/badge/Arxiv-preprint-red"></a>
|
| 3 |
+
<a href="https://welldky.github.io/LongT2IBench-Homepage/"><img src="https://img.shields.io/badge/Homepage-green"></a>
|
| 4 |
+
<!-- <a href="https://huggingface.co/spaces/orpheus0429/FGResQ"><img src="https://img.shields.io/badge/?¤?%20Hugging%20Face-Spaces-blue"></a> -->
|
| 5 |
+
<a href='https://github.com/yzc-ippl/LongT2IBench/stargazers'><img src='https://img.shields.io/github/stars/yzc-ippl/LongT2IBench.svg?style=social'></a>
|
| 6 |
+
|
| 7 |
+
</div>
|
| 8 |
+
|
| 9 |
+
<h1 align="center">LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations</h1>
|
| 10 |
+
|
| 11 |
+
<div align="center">
|
| 12 |
+
<a href="https://github.com/yzc-ippl/" target="_blank">Zhichao Yang</a><sup>1</sup>,
|
| 13 |
+
<a href="https://github.com/welldky" target="_blank">Tianjiao Gu</a><sup>1</sup>,
|
| 14 |
+
<a href="https://github.com/satan-7" target="_blank">Jianjie Wang</a><sup>1</sup>,
|
| 15 |
+
<a href="https://github.com/Guapicat0" target="_blank">Feiyu Lin</a><sup>1</sup>,
|
| 16 |
+
<a href="https://github.com/sxfly99" target="_blank">Xiangfei Sheng</a><sup>1</sup>,
|
| 17 |
+
<a href="https://faculty.xidian.edu.cn/cpf/" target="_blank">Pengfei Chen</a><sup>1*</sup>,
|
| 18 |
+
<a href="https://web.xidian.edu.cn/ldli/" target="_blank">Leida Li</a><sup>1,2*</sup>
|
| 19 |
+
</div>
|
| 20 |
+
|
| 21 |
+
<div align="center">
|
| 22 |
+
<sup>1</sup>School of Artificial Intelligence, Xidian University
|
| 23 |
+
<br>
|
| 24 |
+
<sup>2</sup>State Key Laboratory of Electromechanical Integrated Manufacturing of High-Performance Electronic Equipments, Xidian University
|
| 25 |
+
</div>
|
| 26 |
+
|
| 27 |
+
<div align="center">
|
| 28 |
+
<sup>*</sup>Corresponding author
|
| 29 |
+
</div>
|
| 30 |
+
|
| 31 |
+
<div align="center">
|
| 32 |
+
<img src="LongT2IBench.png" width="800"/>
|
| 33 |
+
</div>
|
| 34 |
+
|
| 35 |
+
<div style="font-family: sans-serif; margin-bottom: 2em;">
|
| 36 |
+
<h2 style="border-bottom: 1px solid #eaecef; padding-bottom: 0.3em; margin-bottom: 1em;">News</h2>
|
| 37 |
+
<ul style="list-style-type: none; padding-left: 0;">
|
| 38 |
+
<li style="margin-bottom: 0.8em;">
|
| 39 |
+
<strong>[2025-12-21]</strong> The training code has been released.
|
| 40 |
+
</li>
|
| 41 |
+
<li style="margin-bottom: 0.8em;">
|
| 42 |
+
<strong>[2025-12-09]</strong> The data and pre-trained models have been released.
|
| 43 |
+
</li>
|
| 44 |
+
<li style="margin-bottom: 0.8em;">
|
| 45 |
+
<strong>[2025-11-08]</strong> Our paper, "LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations", has been accepted for an oral presentation at AAAI 2026!
|
| 46 |
+
</li>
|
| 47 |
+
</ul>
|
| 48 |
+
</div>
|
| 49 |
+
|
| 50 |
+
## Quick Start
|
| 51 |
+
|
| 52 |
+
This guide will help you get started with the LongT2IBench inference code.
|
| 53 |
+
|
| 54 |
+
### 1. Installation
|
| 55 |
+
|
| 56 |
+
First, clone the repository and install the required dependencies.
|
| 57 |
+
|
| 58 |
+
```bash
|
| 59 |
+
git clone https://github.com/yzc-ippl/LongT2IBench.git
|
| 60 |
+
cd LongT2IBench
|
| 61 |
+
pip install -r requirements.txt
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
### 2. Download Pre-trained Weights and Dataset
|
| 65 |
+
|
| 66 |
+
##### Prepare Pre-trained Weights
|
| 67 |
+
|
| 68 |
+
You can download the pre-trained model weights of <strong>[LongT2IExpert]</strong> from the following link: [**(Baidu Netdisk)**](https://pan.baidu.com/s/1Ltj77l31hyBkn6nLtYctnQ?pwd=i8ug)
|
| 69 |
+
|
| 70 |
+
Place the downloaded files in the `weights` directory.
|
| 71 |
+
|
| 72 |
+
- ``./weights/LongT2IBench-checkpoints``: The main model for generation and scoring.
|
| 73 |
+
|
| 74 |
+
Create the `weights` directory if it doesn't exist and place the files inside.
|
| 75 |
+
|
| 76 |
+
##### Prepare Datasets
|
| 77 |
+
|
| 78 |
+
You can download the dataset of <strong>[LongPrompt-3K]</strong> and <strong>[LongT2IBench-14K]</strong> from the following link: [**(Baidu Netdisk)**](https://pan.baidu.com/s/1M_tE9EfA2s0Vn7l9r0GebA?pwd=7b6d)
|
| 79 |
+
|
| 80 |
+
Place the downloaded files in the `data` directory.
|
| 81 |
+
|
| 82 |
+
Create the `data` directory if it doesn't exist and place the files inside.
|
| 83 |
+
|
| 84 |
+
```
|
| 85 |
+
LongT2IBench/
|
| 86 |
+
|-- weights/
|
| 87 |
+
| |-- LongT2IBench-checkpoints
|
| 88 |
+
| | |-- config.json
|
| 89 |
+
| | |-- ...
|
| 90 |
+
| |-- Qwen2.5-VL-7B-Instruct
|
| 91 |
+
| | |-- config.json
|
| 92 |
+
| | |-- ...
|
| 93 |
+
|-- data/
|
| 94 |
+
| |-- imgs
|
| 95 |
+
| |-- split
|
| 96 |
+
| | |-- train.json
|
| 97 |
+
| | |-- test.json
|
| 98 |
+
| | |-- val.json
|
| 99 |
+
|-- config.py
|
| 100 |
+
|-- dataset.py
|
| 101 |
+
|-- model.py
|
| 102 |
+
|-- requirements.txt
|
| 103 |
+
|-- README.md
|
| 104 |
+
|-- test_generation.py
|
| 105 |
+
|-- test_score.py
|
| 106 |
+
|-- train.py
|
| 107 |
+
```
|
| 108 |
+
|
| 109 |
+
### 3. Run Inference
|
| 110 |
+
|
| 111 |
+
The `LongT2IExpert` provides two main inference tasks: Long T2I Alignment Scoring and Long T2I Alignment Interpreting.
|
| 112 |
+
|
| 113 |
+
##### Long T2I Alignment Scoring
|
| 114 |
+
|
| 115 |
+
```
|
| 116 |
+
python test_score.py
|
| 117 |
+
```
|
| 118 |
+
|
| 119 |
+
##### Long T2I Alignment Interpreting
|
| 120 |
+
|
| 121 |
+
```
|
| 122 |
+
python test_generation.py
|
| 123 |
+
```
|
| 124 |
+
|
| 125 |
+
### 4. Run Training
|
| 126 |
+
|
| 127 |
+
You can run this code to train <strong>[LongT2IExpert]</strong> from start to finish.
|
| 128 |
+
|
| 129 |
+
Make sure the initially untrained weights are located at ``./weights/Qwen2.5-VL-7B-Instruct`` :
|
| 130 |
+
|
| 131 |
+
You can download the untrained weights from the following link [**(Baidu Netdisk)**](https://pan.baidu.com/s/17PcO4CvgB6FDHh6JBgM_Lg?pwd=3h8m)
|
| 132 |
+
|
| 133 |
+
```bash
|
| 134 |
+
python train.py
|
| 135 |
+
```
|
| 136 |
+
|
| 137 |
+
## Citation
|
| 138 |
+
|
| 139 |
+
If you find this work is useful, pleaes cite our paper!
|
| 140 |
+
|
| 141 |
+
```bibtex
|
| 142 |
+
@misc{yang2025longt2ibenchbenchmarkevaluatinglong,
|
| 143 |
+
title={LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations},
|
| 144 |
+
author={Zhichao Yang and Tianjiao Gu and Jianjie Wang and Feiyu Lin and Xiangfei Sheng and Pengfei Chen and Leida Li},
|
| 145 |
+
year={2025},
|
| 146 |
+
eprint={2512.09271},
|
| 147 |
+
archivePrefix={arXiv},
|
| 148 |
+
primaryClass={cs.CV},
|
| 149 |
+
url={https://arxiv.org/abs/2512.09271},
|
| 150 |
+
}
|
| 151 |
+
```
|