Add parsing pipeline section to model card
#13
by wunu - opened
- README.md +11 -2
- assets/parsing_pipeline.svg +68 -0
README.md
CHANGED
|
@@ -128,7 +128,16 @@ Original documents and parsed results, side by side.
|
|
| 128 |
| Parsing pipeline | MiniCPM-OCR 1.0 + PP-DocLayoutV3 layout model + `minicpmvocr` SDK |
|
| 129 |
| Visual tokens | 4× compression, `scale_resolution` 448, up to 9 slices |
|
| 130 |
|
| 131 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 132 |
deployment options, and benchmark breakdowns.
|
| 133 |
|
| 134 |
## Quick start
|
|
@@ -337,4 +346,4 @@ Installation, model downloads, GPU memory, input formats, and unexpected outputs
|
|
| 337 |
## License
|
| 338 |
|
| 339 |
Model weights, code, and documentation are released under the
|
| 340 |
-
[Apache License 2.0](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/LICENSE).
|
|
|
|
| 128 |
| Parsing pipeline | MiniCPM-OCR 1.0 + PP-DocLayoutV3 layout model + `minicpmvocr` SDK |
|
| 129 |
| Visual tokens | 4× compression, `scale_resolution` 448, up to 9 slices |
|
| 130 |
|
| 131 |
+
### Parsing pipeline
|
| 132 |
+
|
| 133 |
+
Full-page parsing runs as a **two-stage pipeline** orchestrated by the [`minicpmvocr` SDK](https://pypi.org/project/minicpm-ocr/). The two stages use separate models, run in separate environments, and may run on different machines:
|
| 134 |
+
|
| 135 |
+
- **Stage 1 — Layout detection (SDK environment).** The PP-DocLayoutV3 layout model detects document regions — text, tables, formulas, charts, seals — and determines reading order; the SDK crops each region. It runs locally inside the SDK environment and requires PaddlePaddle / PaddleX.
|
| 136 |
+
- **Stage 2 — Region recognition (inference service).** The SDK sends each cropped region over HTTP to a MiniCPM-OCR 1.0 inference service — served by vLLM, SGLang, llama.cpp, or Ollama — with a prompt matching the region type, then assembles the recognized content into the final Markdown / JSON in reading order.
|
| 137 |
+
|
| 138 |
+
<p align="center"><img src="assets/parsing_pipeline.svg" alt="Parsing pipeline: in the minicpmvocr SDK environment, the PP-DocLayoutV3 layout model detects and crops document regions; each cropped region is sent over HTTP to a separate recognition service running MiniCPM-OCR 1.0 (vLLM, SGLang, llama.cpp, or Ollama); the SDK then assembles the recognised text, tables, formulas, charts, and seals into Markdown and JSON in reading order." width="90%"></p>
|
| 139 |
+
|
| 140 |
+
See the [model guide](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/minicpm_ocr_1dot0_en.md) for more on architecture, parsing workflow,
|
| 141 |
deployment options, and benchmark breakdowns.
|
| 142 |
|
| 143 |
## Quick start
|
|
|
|
| 346 |
## License
|
| 347 |
|
| 348 |
Model weights, code, and documentation are released under the
|
| 349 |
+
[Apache License 2.0](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/LICENSE).
|
assets/parsing_pipeline.svg
ADDED
|
|