File size: 1,283 Bytes
3299477 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | ---
license: apache-2.0
tags:
- ocr
- document-parsing
- pdf
- pipeline
- olmocr-bench
---
# TrueDoc: a PDF-to-markdown pipeline, measured on olmOCR-bench
**This repository holds a benchmark result, not model weights.** TrueDoc converts PDFs to markdown with a YAML
front matter (the Open Knowledge Format) and is built for *meaning accuracy*: does the output say what a reader of
the page would understand it to say? Its code is at https://github.com/islandtimer/TrueDoc (Apache-2.0). The models it uses are other
people's: Infinity-Parser2-Flash and -Pro (infly), olmOCR-2-7B-1025 (allenai), docling-layout-heron
(docling-project), all Apache-2.0.
**olmOCR-bench, run 97: 86.8** (95% bootstrap CI 86.0-87.7), official scorer, all eight sections,
dataset revision `54a96a6f`. [RESULTS.md](RESULTS.md) has the section scores, exactly what read which pages, and
how to re-score the 1,403 outputs in `outputs/` yourself.
The arrangement, in one line: the PDF's own text for the 1,122 pages that have it (no model), Infinity-Parser2-Flash
for the 281 that do not, Infinity-Parser2-Pro behind it for the 102 the pipeline's own OCR cannot read, olmOCR 2
for 92 picture regions; readings recorded on a rented GPU and replayed; no post-processing keyed on the
benchmark's folder names.
|