Image Feature Extraction
Transformers
Safetensors
monkeyocrv2_vitae_encoder
feature-extraction
custom_code
Instructions to use zenosai/MonkeyOCRv2-AS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zenosai/MonkeyOCRv2-AS with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="zenosai/MonkeyOCRv2-AS", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zenosai/MonkeyOCRv2-AS", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update pipeline tag to image-feature-extraction and add library name (#1)
Browse files- Update pipeline tag to image-feature-extraction and add library name (ea1e44eab70a79ae5b109c0a2bf13e673750feef)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -1,9 +1,11 @@
|
|
| 1 |
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
datasets:
|
| 4 |
- zenosai/MonkeyDocv2
|
| 5 |
-
|
|
|
|
|
|
|
| 6 |
---
|
|
|
|
| 7 |
<div align="center" xmlns="http://www.w3.org/1999/html">
|
| 8 |
<h2>
|
| 9 |
<b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
|
|
@@ -13,7 +15,7 @@ pipeline_tag: image-text-to-text
|
|
| 13 |
[](https://huggingface.co/collections/zenosai/monkeyocrv2)
|
| 14 |
[](https://modelscope.cn/datasets/zenosai/MonkeyDocv2)
|
| 15 |
[](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aopen+is%3Aissue)
|
| 16 |
-
[](http://vlrlabmonkey.xyz:8891/)
|
| 18 |
|
| 19 |
<img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png" width="600"/>
|
|
@@ -25,6 +27,7 @@ pipeline_tag: image-text-to-text
|
|
| 25 |
## Introduction
|
| 26 |
MonkeyOCRv2 is a text-centric visual foundation model that unifies fine-grained text modeling, cross-task representation learning, and cross-lingual generalization in a single encoder. MonkeyOCRv2 generalizes effectively across a broad range of OCR and document intelligence tasks, including multilingual document parsing, document understanding, text recognition, formula recognition, document tampering detection, scene text detection, and overlapping text segmentation.
|
| 27 |
|
|
|
|
| 28 |
|
| 29 |
## Model Zoo
|
| 30 |
|
|
@@ -324,15 +327,15 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
|
|
| 324 |
<th style="text-align: center;" rowspan="2">Occlusion SceneText</th>
|
| 325 |
</tr>
|
| 326 |
<tr>
|
| 327 |
-
<th><strong>Avg</th>
|
| 328 |
<th>Artistic</th>
|
| 329 |
<th>Context less</th>
|
| 330 |
<th>Curve</th>
|
| 331 |
<th>General</th>
|
| 332 |
<th>Multi Oriented</th>
|
| 333 |
-
<th>Multi Words
|
| 334 |
<th>Saliency</th>
|
| 335 |
-
<th><strong>Avg</th>
|
| 336 |
<th>Scene</th>
|
| 337 |
<th>Web</th>
|
| 338 |
<th>Document</th>
|
|
@@ -998,9 +1001,9 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
|
|
| 998 |
<tr>
|
| 999 |
<td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
|
| 1000 |
</tr>
|
| 1001 |
-
<tr>
|
| 1002 |
-
<td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
|
| 1003 |
-
</tr>
|
| 1004 |
</tbody>
|
| 1005 |
</table>
|
| 1006 |
|
|
@@ -1189,4 +1192,4 @@ This multi-expert agreement strategy reduces model-specific annotation errors an
|
|
| 1189 |
- **Qwen3**: https://github.com/QwenLM/Qwen3
|
| 1190 |
|
| 1191 |
## Copyright
|
| 1192 |
-
We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
datasets:
|
| 3 |
- zenosai/MonkeyDocv2
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: image-feature-extraction
|
| 7 |
---
|
| 8 |
+
|
| 9 |
<div align="center" xmlns="http://www.w3.org/1999/html">
|
| 10 |
<h2>
|
| 11 |
<b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
|
|
|
|
| 15 |
[](https://huggingface.co/collections/zenosai/monkeyocrv2)
|
| 16 |
[](https://modelscope.cn/datasets/zenosai/MonkeyDocv2)
|
| 17 |
[](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aopen+is%3Aissue)
|
| 18 |
+
[](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aissue+is%3Aclosed)
|
| 19 |
[](http://vlrlabmonkey.xyz:8891/)
|
| 20 |
|
| 21 |
<img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png" width="600"/>
|
|
|
|
| 27 |
## Introduction
|
| 28 |
MonkeyOCRv2 is a text-centric visual foundation model that unifies fine-grained text modeling, cross-task representation learning, and cross-lingual generalization in a single encoder. MonkeyOCRv2 generalizes effectively across a broad range of OCR and document intelligence tasks, including multilingual document parsing, document understanding, text recognition, formula recognition, document tampering detection, scene text detection, and overlapping text segmentation.
|
| 29 |
|
| 30 |
+
More details can be found in the paper [MonkeyOCRv2: A Visual-Text Foundation Model for Document AI](https://arxiv.org/abs/2607.11562).
|
| 31 |
|
| 32 |
## Model Zoo
|
| 33 |
|
|
|
|
| 327 |
<th style="text-align: center;" rowspan="2">Occlusion SceneText</th>
|
| 328 |
</tr>
|
| 329 |
<tr>
|
| 330 |
+
<th><strong>Avg</strong></th>
|
| 331 |
<th>Artistic</th>
|
| 332 |
<th>Context less</th>
|
| 333 |
<th>Curve</th>
|
| 334 |
<th>General</th>
|
| 335 |
<th>Multi Oriented</th>
|
| 336 |
+
<th>Multi Words</th>
|
| 337 |
<th>Saliency</th>
|
| 338 |
+
<th><strong>Avg</strong></th>
|
| 339 |
<th>Scene</th>
|
| 340 |
<th>Web</th>
|
| 341 |
<th>Document</th>
|
|
|
|
| 1001 |
<tr>
|
| 1002 |
<td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
|
| 1003 |
</tr>
|
| 1004 |
+
<tr>
|
| 1005 |
+
<td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
|
| 1006 |
+
</tr>
|
| 1007 |
</tbody>
|
| 1008 |
</table>
|
| 1009 |
|
|
|
|
| 1192 |
- **Qwen3**: https://github.com/QwenLM/Qwen3
|
| 1193 |
|
| 1194 |
## Copyright
|
| 1195 |
+
We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.
|