Instructions to use zenosai/MonkeyOCRv2-S with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zenosai/MonkeyOCRv2-S with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="zenosai/MonkeyOCRv2-S", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zenosai/MonkeyOCRv2-S", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update pipeline tag, add library name, and add citation reference
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,9 +1,11 @@
|
|
| 1 |
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
datasets:
|
| 4 |
- zenosai/MonkeyDocv2
|
| 5 |
-
|
|
|
|
|
|
|
| 6 |
---
|
|
|
|
| 7 |
<div align="center" xmlns="http://www.w3.org/1999/html">
|
| 8 |
<h2>
|
| 9 |
<b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
|
|
@@ -533,7 +535,7 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
|
|
| 533 |
#### 3. Text detection results on Total-Text, CTW1500, ICDAR2015 and ArT. We follow the training and evaluation protocols of [MMOCR](https://github.com/open-mmlab/mmocr) and [DPText-DETR](https://github.com/ymy-k/DPText-DETR).
|
| 534 |
|
| 535 |
<p align="center">
|
| 536 |
-
<img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png
|
| 537 |
</p>
|
| 538 |
|
| 539 |
|
|
@@ -995,12 +997,12 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
|
|
| 995 |
<tr>
|
| 996 |
<td>dots.mocr</td><td>3B</td><td>1.2B</td><td>1.8B</td><td>80.5</td><td><strong>90.5</strong></td><td>77.2</td><td>81.7</td><td>82.6</td><td><strong>87.4</strong></td><td>71.3</td><td>70.1</td><td>84.5</td><td><strong>89.3</strong></td><td>83.2</td><td>86.8</td><td>79.9</td><td>79.2</td><td>83.3</td><td>83.6</td><td><strong>75.0</strong></td><td>78.7</td><td>71.2</td><td>77.9</td><td><u>84.6</u></td><td><strong>79.6</strong></td>
|
| 997 |
</tr>
|
| 998 |
-
<tr>
|
| 999 |
-
<td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
|
| 1000 |
-
</tr>
|
| 1001 |
-
<tr>
|
| 1002 |
-
<td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
|
| 1003 |
-
</tr>
|
| 1004 |
</tbody>
|
| 1005 |
</table>
|
| 1006 |
|
|
@@ -1190,3 +1192,15 @@ This multi-expert agreement strategy reduces model-specific annotation errors an
|
|
| 1190 |
|
| 1191 |
## Copyright
|
| 1192 |
We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
datasets:
|
| 3 |
- zenosai/MonkeyDocv2
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
pipeline_tag: image-feature-extraction
|
| 6 |
+
library_name: transformers
|
| 7 |
---
|
| 8 |
+
|
| 9 |
<div align="center" xmlns="http://www.w3.org/1999/html">
|
| 10 |
<h2>
|
| 11 |
<b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
|
|
|
|
| 535 |
#### 3. Text detection results on Total-Text, CTW1500, ICDAR2015 and ArT. We follow the training and evaluation protocols of [MMOCR](https://github.com/open-mmlab/mmocr) and [DPText-DETR](https://github.com/ymy-k/DPText-DETR).
|
| 536 |
|
| 537 |
<p align="center">
|
| 538 |
+
<img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png" width="600"/>
|
| 539 |
</p>
|
| 540 |
|
| 541 |
|
|
|
|
| 997 |
<tr>
|
| 998 |
<td>dots.mocr</td><td>3B</td><td>1.2B</td><td>1.8B</td><td>80.5</td><td><strong>90.5</strong></td><td>77.2</td><td>81.7</td><td>82.6</td><td><strong>87.4</strong></td><td>71.3</td><td>70.1</td><td>84.5</td><td><strong>89.3</strong></td><td>83.2</td><td>86.8</td><td>79.9</td><td>79.2</td><td>83.3</td><td>83.6</td><td><strong>75.0</strong></td><td>78.7</td><td>71.2</td><td>77.9</td><td><u>84.6</u></td><td><strong>79.6</strong></td>
|
| 999 |
</tr>
|
| 1000 |
+
<tr>
|
| 1001 |
+
<td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
|
| 1002 |
+
</tr>
|
| 1003 |
+
<tr>
|
| 1004 |
+
<td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
|
| 1005 |
+
</tr>
|
| 1006 |
</tbody>
|
| 1007 |
</table>
|
| 1008 |
|
|
|
|
| 1192 |
|
| 1193 |
## Copyright
|
| 1194 |
We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.
|
| 1195 |
+
|
| 1196 |
+
## Citation
|
| 1197 |
+
If you find **MonkeyOCRv2** useful, consider citing our work:
|
| 1198 |
+
|
| 1199 |
+
```bibtex
|
| 1200 |
+
@article{liu2026monkeyocrv2,
|
| 1201 |
+
title={MonkeyOCRv2: A Visual-Text Foundation Model for Document AI},
|
| 1202 |
+
author={Yuliang Liu and Zhang Li and Ziyang Zhang and Shuo Zhang and Qiang Liu and Jiajun Song and Zidun Guo and Xinhan Wang and Handong Zheng and Yang Liu and Dongliang Luo and Zhiyin Ma and Jiarui Zhang and Xiang Bai},
|
| 1203 |
+
journal={arXiv preprint arXiv:2607.11562},
|
| 1204 |
+
year={2026}
|
| 1205 |
+
}
|
| 1206 |
+
```
|