Add model card for UnionST

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +44 -0
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: image-to-text
4
+ tags:
5
+ - ocr
6
+ - scene-text-recognition
7
+ - synthetic-data
8
+ ---
9
+
10
+ # UnionST: A Strong Synthetic Engine for Scene Text Recognition
11
+
12
+ This repository contains model checkpoints for **UnionST**, introduced in the paper [What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution](https://huggingface.co/papers/2602.06450).
13
+
14
+ ## Introduction
15
+ Scene Text Recognition (STR) relies critically on large-scale, high-quality training data. While synthetic data provides a cost-effective alternative to manually annotated real data, existing rendering-based synthetic datasets often suffer from a domain gap with real-world text due to insufficient diversity.
16
+
17
+ UnionST is a strong data engine that synthesizes text covering a union of challenging samples to better align with the complexity observed in the wild. Models trained on the resulting UnionST-S dataset achieve significant improvements over traditional synthetic datasets on challenging STR benchmarks.
18
+
19
+ ## Resources
20
+ - **Paper:** [arXiv:2602.06450](https://arxiv.org/abs/2602.06450)
21
+ - **Code:** [GitHub - YesianRohn/UnionST](https://github.com/YesianRohn/UnionST)
22
+ - **Datasets:** [UnionST Dataset on Hugging Face](https://huggingface.co/datasets/Yesianrohn/UnionST)
23
+
24
+ ## Training
25
+ The models (such as SVTRv2-AR) are implemented using the [OpenOCR](https://github.com/Topdu/OpenOCR) framework. Training can be initiated with:
26
+
27
+ ```bash
28
+ cd OpenOCR
29
+ torchrun --nproc_per_node=8 tools/train_rec.py --c configs/rec/nrtr/svtrv2_nrtr_unionst.yml
30
+ ```
31
+
32
+ ## Citation
33
+ If you find this work useful, please cite:
34
+ ```bibtex
35
+ @inproceedings{ye2026wrong,
36
+ title={What's Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution},
37
+ author={Ye, Xingsong and Du, Yongkun and Zhang, JiaXin and Li, Chen and LYU, Jing and Chen, Zhineng},
38
+ booktitle={CVPR},
39
+ year={2026}
40
+ }
41
+ ```
42
+
43
+ ## License
44
+ This project is licensed under the MIT License.