yzc002 commited on
Commit
f4ebfc5
·
verified ·
1 Parent(s): 7819d1a

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +151 -0
README.md ADDED
@@ -0,0 +1,151 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <div align="center">
2
+ <a href="https://arxiv.org/abs/2512.09271"><img src="https://img.shields.io/badge/Arxiv-preprint-red"></a>
3
+ <a href="https://welldky.github.io/LongT2IBench-Homepage/"><img src="https://img.shields.io/badge/Homepage-green"></a>
4
+ <!-- <a href="https://huggingface.co/spaces/orpheus0429/FGResQ"><img src="https://img.shields.io/badge/?¤?%20Hugging%20Face-Spaces-blue"></a> -->
5
+ <a href='https://github.com/yzc-ippl/LongT2IBench/stargazers'><img src='https://img.shields.io/github/stars/yzc-ippl/LongT2IBench.svg?style=social'></a>
6
+
7
+ </div>
8
+
9
+ <h1 align="center">LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations</h1>
10
+
11
+ <div align="center">
12
+ <a href="https://github.com/yzc-ippl/" target="_blank">Zhichao Yang</a><sup>1</sup>,
13
+ <a href="https://github.com/welldky" target="_blank">Tianjiao Gu</a><sup>1</sup>,
14
+ <a href="https://github.com/satan-7" target="_blank">Jianjie Wang</a><sup>1</sup>,
15
+ <a href="https://github.com/Guapicat0" target="_blank">Feiyu Lin</a><sup>1</sup>,
16
+ <a href="https://github.com/sxfly99" target="_blank">Xiangfei Sheng</a><sup>1</sup>,
17
+ <a href="https://faculty.xidian.edu.cn/cpf/" target="_blank">Pengfei Chen</a><sup>1*</sup>,
18
+ <a href="https://web.xidian.edu.cn/ldli/" target="_blank">Leida Li</a><sup>1,2*</sup>
19
+ </div>
20
+
21
+ <div align="center">
22
+ <sup>1</sup>School of Artificial Intelligence, Xidian University
23
+ <br>
24
+ <sup>2</sup>State Key Laboratory of Electromechanical Integrated Manufacturing of High-Performance Electronic Equipments, Xidian University
25
+ </div>
26
+
27
+ <div align="center">
28
+ <sup>*</sup>Corresponding author
29
+ </div>
30
+
31
+ <div align="center">
32
+ <img src="LongT2IBench.png" width="800"/>
33
+ </div>
34
+
35
+ <div style="font-family: sans-serif; margin-bottom: 2em;">
36
+ <h2 style="border-bottom: 1px solid #eaecef; padding-bottom: 0.3em; margin-bottom: 1em;">News</h2>
37
+ <ul style="list-style-type: none; padding-left: 0;">
38
+ <li style="margin-bottom: 0.8em;">
39
+ <strong>[2025-12-21]</strong> The training code has been released.
40
+ </li>
41
+ <li style="margin-bottom: 0.8em;">
42
+ <strong>[2025-12-09]</strong> The data and pre-trained models have been released.
43
+ </li>
44
+ <li style="margin-bottom: 0.8em;">
45
+ <strong>[2025-11-08]</strong> Our paper, "LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations", has been accepted for an oral presentation at AAAI 2026!
46
+ </li>
47
+ </ul>
48
+ </div>
49
+
50
+ ## Quick Start
51
+
52
+ This guide will help you get started with the LongT2IBench inference code.
53
+
54
+ ### 1. Installation
55
+
56
+ First, clone the repository and install the required dependencies.
57
+
58
+ ```bash
59
+ git clone https://github.com/yzc-ippl/LongT2IBench.git
60
+ cd LongT2IBench
61
+ pip install -r requirements.txt
62
+ ```
63
+
64
+ ### 2. Download Pre-trained Weights and Dataset
65
+
66
+ ##### Prepare Pre-trained Weights
67
+
68
+ You can download the pre-trained model weights of <strong>[LongT2IExpert]</strong> from the following link: [**(Baidu Netdisk)**](https://pan.baidu.com/s/1Ltj77l31hyBkn6nLtYctnQ?pwd=i8ug)
69
+
70
+ Place the downloaded files in the `weights` directory.
71
+
72
+ - ``./weights/LongT2IBench-checkpoints``: The main model for generation and scoring.
73
+
74
+ Create the `weights` directory if it doesn't exist and place the files inside.
75
+
76
+ ##### Prepare Datasets
77
+
78
+ You can download the dataset of <strong>[LongPrompt-3K]</strong> and <strong>[LongT2IBench-14K]</strong> from the following link: [**(Baidu Netdisk)**](https://pan.baidu.com/s/1M_tE9EfA2s0Vn7l9r0GebA?pwd=7b6d)
79
+
80
+ Place the downloaded files in the `data` directory.
81
+
82
+ Create the `data` directory if it doesn't exist and place the files inside.
83
+
84
+ ```
85
+ LongT2IBench/
86
+ |-- weights/
87
+ | |-- LongT2IBench-checkpoints
88
+ | | |-- config.json
89
+ | | |-- ...
90
+ | |-- Qwen2.5-VL-7B-Instruct
91
+ | | |-- config.json
92
+ | | |-- ...
93
+ |-- data/
94
+ | |-- imgs
95
+ | |-- split
96
+ | | |-- train.json
97
+ | | |-- test.json
98
+ | | |-- val.json
99
+ |-- config.py
100
+ |-- dataset.py
101
+ |-- model.py
102
+ |-- requirements.txt
103
+ |-- README.md
104
+ |-- test_generation.py
105
+ |-- test_score.py
106
+ |-- train.py
107
+ ```
108
+
109
+ ### 3. Run Inference
110
+
111
+ The `LongT2IExpert` provides two main inference tasks: Long T2I Alignment Scoring and Long T2I Alignment Interpreting.
112
+
113
+ ##### Long T2I Alignment Scoring
114
+
115
+ ```
116
+ python test_score.py
117
+ ```
118
+
119
+ ##### Long T2I Alignment Interpreting
120
+
121
+ ```
122
+ python test_generation.py
123
+ ```
124
+
125
+ ### 4. Run Training
126
+
127
+ You can run this code to train <strong>[LongT2IExpert]</strong> from start to finish.
128
+
129
+ Make sure the initially untrained weights are located at ``./weights/Qwen2.5-VL-7B-Instruct`` :
130
+
131
+ You can download the untrained weights from the following link [**(Baidu Netdisk)**](https://pan.baidu.com/s/17PcO4CvgB6FDHh6JBgM_Lg?pwd=3h8m)
132
+
133
+ ```bash
134
+ python train.py
135
+ ```
136
+
137
+ ## Citation
138
+
139
+ If you find this work is useful, pleaes cite our paper!
140
+
141
+ ```bibtex
142
+ @misc{yang2025longt2ibenchbenchmarkevaluatinglong,
143
+ title={LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations},
144
+ author={Zhichao Yang and Tianjiao Gu and Jianjie Wang and Feiyu Lin and Xiangfei Sheng and Pengfei Chen and Leida Li},
145
+ year={2025},
146
+ eprint={2512.09271},
147
+ archivePrefix={arXiv},
148
+ primaryClass={cs.CV},
149
+ url={https://arxiv.org/abs/2512.09271},
150
+ }
151
+ ```