zenosai nielsr HF Staff commited on
Commit
5699ab6
·
1 Parent(s): fa05838

Update pipeline tag to image-feature-extraction and add library name (#1)

Browse files

- Update pipeline tag to image-feature-extraction and add library name (ea1e44eab70a79ae5b109c0a2bf13e673750feef)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +13 -10
README.md CHANGED
@@ -1,9 +1,11 @@
1
  ---
2
- license: apache-2.0
3
  datasets:
4
  - zenosai/MonkeyDocv2
5
- pipeline_tag: image-text-to-text
 
 
6
  ---
 
7
  <div align="center" xmlns="http://www.w3.org/1999/html">
8
  <h2>
9
  <b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
@@ -13,7 +15,7 @@ pipeline_tag: image-text-to-text
13
  [![MonkeyOCRv2](https://img.shields.io/badge/MonkeyOCRv2-black.svg?logo=Huggingface)](https://huggingface.co/collections/zenosai/monkeyocrv2)
14
  [![MonkeyDocv2](https://img.shields.io/badge/MonkeyDoc_v2-blue.svg?logo=ModelScope)](https://modelscope.cn/datasets/zenosai/MonkeyDocv2)
15
  [![GitHub issues](https://img.shields.io/github/issues/Yuliang-Liu/MonkeyOCRv2?color=critical&label=Issues)](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aopen+is%3Aissue)
16
- [![GitHub closed issues](https://img.shields.io/github/issues-closed/Yuliang-Liu/MonkeyOCRv2?color=success&label=Issues)](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aissue+is%3Aclosed)
17
  [![Demo](https://img.shields.io/badge/Demo-white.svg)](http://vlrlabmonkey.xyz:8891/)
18
 
19
  <img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png" width="600"/>
@@ -25,6 +27,7 @@ pipeline_tag: image-text-to-text
25
  ## Introduction
26
  MonkeyOCRv2 is a text-centric visual foundation model that unifies fine-grained text modeling, cross-task representation learning, and cross-lingual generalization in a single encoder. MonkeyOCRv2 generalizes effectively across a broad range of OCR and document intelligence tasks, including multilingual document parsing, document understanding, text recognition, formula recognition, document tampering detection, scene text detection, and overlapping text segmentation.
27
 
 
28
 
29
  ## Model Zoo
30
 
@@ -324,15 +327,15 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
324
  <th style="text-align: center;" rowspan="2">Occlusion SceneText</th>
325
  </tr>
326
  <tr>
327
- <th><strong>Avg</th>
328
  <th>Artistic</th>
329
  <th>Context less</th>
330
  <th>Curve</th>
331
  <th>General</th>
332
  <th>Multi Oriented</th>
333
- <th>Multi Words </th>
334
  <th>Saliency</th>
335
- <th><strong>Avg</th>
336
  <th>Scene</th>
337
  <th>Web</th>
338
  <th>Document</th>
@@ -998,9 +1001,9 @@ Our model supports robust document parsing in real-world scenarios across 17 lan
998
  <tr>
999
  <td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
1000
  </tr>
1001
- <tr>
1002
- <td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
1003
- </tr>
1004
  </tbody>
1005
  </table>
1006
 
@@ -1189,4 +1192,4 @@ This multi-expert agreement strategy reduces model-specific annotation errors an
1189
  - **Qwen3**: https://github.com/QwenLM/Qwen3
1190
 
1191
  ## Copyright
1192
- We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.
 
1
  ---
 
2
  datasets:
3
  - zenosai/MonkeyDocv2
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: image-feature-extraction
7
  ---
8
+
9
  <div align="center" xmlns="http://www.w3.org/1999/html">
10
  <h2>
11
  <b>MonkeyOCRv2: A Visual-Text Foundation Model for Document AI</b>
 
15
  [![MonkeyOCRv2](https://img.shields.io/badge/MonkeyOCRv2-black.svg?logo=Huggingface)](https://huggingface.co/collections/zenosai/monkeyocrv2)
16
  [![MonkeyDocv2](https://img.shields.io/badge/MonkeyDoc_v2-blue.svg?logo=ModelScope)](https://modelscope.cn/datasets/zenosai/MonkeyDocv2)
17
  [![GitHub issues](https://img.shields.io/github/issues/Yuliang-Liu/MonkeyOCRv2?color=critical&label=Issues)](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aopen+is%3Aissue)
18
+ [![GitHub closed images](https://img.shields.io/github/issues-closed/Yuliang-Liu/MonkeyOCRv2?color=success&label=Issues)](https://github.com/Yuliang-Liu/MonkeyOCRv2/issues?q=is%3Aissue+is%3Aclosed)
19
  [![Demo](https://img.shields.io/badge/Demo-white.svg)](http://vlrlabmonkey.xyz:8891/)
20
 
21
  <img src="https://raw.githubusercontent.com/Yuliang-Liu/MonkeyOCRv2/refs/heads/main/asserts/overview.png" width="600"/>
 
27
  ## Introduction
28
  MonkeyOCRv2 is a text-centric visual foundation model that unifies fine-grained text modeling, cross-task representation learning, and cross-lingual generalization in a single encoder. MonkeyOCRv2 generalizes effectively across a broad range of OCR and document intelligence tasks, including multilingual document parsing, document understanding, text recognition, formula recognition, document tampering detection, scene text detection, and overlapping text segmentation.
29
 
30
+ More details can be found in the paper [MonkeyOCRv2: A Visual-Text Foundation Model for Document AI](https://arxiv.org/abs/2607.11562).
31
 
32
  ## Model Zoo
33
 
 
327
  <th style="text-align: center;" rowspan="2">Occlusion SceneText</th>
328
  </tr>
329
  <tr>
330
+ <th><strong>Avg</strong></th>
331
  <th>Artistic</th>
332
  <th>Context less</th>
333
  <th>Curve</th>
334
  <th>General</th>
335
  <th>Multi Oriented</th>
336
+ <th>Multi Words</th>
337
  <th>Saliency</th>
338
+ <th><strong>Avg</strong></th>
339
  <th>Scene</th>
340
  <th>Web</th>
341
  <th>Document</th>
 
1001
  <tr>
1002
  <td><strong>MonkeyOCRv2-S-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-S-Parsing">🤗</a></strong></td><td>0.6B</td><td>0.03B</td><td>0.6B</td><td><u>82.5</u></td><td>87.9</td><td><u>80.7</u></td><td><u>83.2</u></td><td><u>87.3</u></td><td>83.6</td><td><strong>76.8</strong></td><td>73.6</td><td><u>85.4</u></td><td>87.2</td><td><u>85.5</u></td><td>87.4</td><td>81.9</td><td><u>81.7</u></td><td><strong>91.2</strong></td><td><u>87.1</u></td><td>69.9</td><td><strong>88.7</strong></td><td><u>78.0</u></td><td><u>79.8</u></td><td>84.4</td><td>74.7</td>
1003
  </tr>
1004
+ <tr>
1005
+ <td><strong>MonkeyOCRv2-B-Parsing<a href="https://huggingface.co/zenosai/MonkeyOCRv2-B-Parsing">🤗</a><strong></td><td>0.7B</td><td>0.1B</td><td>0.6B</td><td><strong>83.3</strong></td><td><u>88.1</u></td><td><strong>81.7</strong></td><td><strong>84.2</strong></td><td><strong>87.7</strong></td><td>84.5</td><td>75.2</td><td><strong>78.4</strong></td><td><strong>86.5</strong></td><td><u>88.6</u></td><td><strong>86.1</strong></td><td>87.9</td><td>83.2</td><td><strong>82.1</strong></td><td><u>90.7</u></td><td><strong>87.2</strong></td><td>71.9</td><td><u>87.6</u></td><td><strong>80.1</strong></td><td><strong>80.8</strong></td><td>83.6</td><td>75.3</td>
1006
+ </tr>
1007
  </tbody>
1008
  </table>
1009
 
 
1192
  - **Qwen3**: https://github.com/QwenLM/Qwen3
1193
 
1194
  ## Copyright
1195
+ We warmly welcome your feedback, suggestions, and contributions, which are essential to the continued development and improvement of our framework. Note: This model is intended for academic research and non-commercial use only. For any questions, please contact us at xbai@hust.edu.cn or ylliu@hust.edu.cn.