Add parsing pipeline section to model card

#13
by wunu - opened
Files changed (2) hide show
  1. README.md +11 -2
  2. assets/parsing_pipeline.svg +68 -0
README.md CHANGED
@@ -128,7 +128,16 @@ Original documents and parsed results, side by side.
128
  | Parsing pipeline | MiniCPM-OCR 1.0 + PP-DocLayoutV3 layout model + `minicpmvocr` SDK |
129
  | Visual tokens | 4× compression, `scale_resolution` 448, up to 9 slices |
130
 
131
- See the [model guide](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/minicpm_ocr_1dot0_en.md) for architecture, parsing workflow,
 
 
 
 
 
 
 
 
 
132
  deployment options, and benchmark breakdowns.
133
 
134
  ## Quick start
@@ -337,4 +346,4 @@ Installation, model downloads, GPU memory, input formats, and unexpected outputs
337
  ## License
338
 
339
  Model weights, code, and documentation are released under the
340
- [Apache License 2.0](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/LICENSE).
 
128
  | Parsing pipeline | MiniCPM-OCR 1.0 + PP-DocLayoutV3 layout model + `minicpmvocr` SDK |
129
  | Visual tokens | 4× compression, `scale_resolution` 448, up to 9 slices |
130
 
131
+ ### Parsing pipeline
132
+
133
+ Full-page parsing runs as a **two-stage pipeline** orchestrated by the [`minicpmvocr` SDK](https://pypi.org/project/minicpm-ocr/). The two stages use separate models, run in separate environments, and may run on different machines:
134
+
135
+ - **Stage 1 — Layout detection (SDK environment).** The PP-DocLayoutV3 layout model detects document regions — text, tables, formulas, charts, seals — and determines reading order; the SDK crops each region. It runs locally inside the SDK environment and requires PaddlePaddle / PaddleX.
136
+ - **Stage 2 — Region recognition (inference service).** The SDK sends each cropped region over HTTP to a MiniCPM-OCR 1.0 inference service — served by vLLM, SGLang, llama.cpp, or Ollama — with a prompt matching the region type, then assembles the recognized content into the final Markdown / JSON in reading order.
137
+
138
+ <p align="center"><img src="assets/parsing_pipeline.svg" alt="Parsing pipeline: in the minicpmvocr SDK environment, the PP-DocLayoutV3 layout model detects and crops document regions; each cropped region is sent over HTTP to a separate recognition service running MiniCPM-OCR 1.0 (vLLM, SGLang, llama.cpp, or Ollama); the SDK then assembles the recognised text, tables, formulas, charts, and seals into Markdown and JSON in reading order." width="90%"></p>
139
+
140
+ See the [model guide](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/minicpm_ocr_1dot0_en.md) for more on architecture, parsing workflow,
141
  deployment options, and benchmark breakdowns.
142
 
143
  ## Quick start
 
346
  ## License
347
 
348
  Model weights, code, and documentation are released under the
349
+ [Apache License 2.0](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/LICENSE).
assets/parsing_pipeline.svg ADDED