File size: 1,283 Bytes
3299477
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
---
license: apache-2.0
tags:
- ocr
- document-parsing
- pdf
- pipeline
- olmocr-bench
---

# TrueDoc: a PDF-to-markdown pipeline, measured on olmOCR-bench

**This repository holds a benchmark result, not model weights.** TrueDoc converts PDFs to markdown with a YAML
front matter (the Open Knowledge Format) and is built for *meaning accuracy*: does the output say what a reader of
the page would understand it to say? Its code is at https://github.com/islandtimer/TrueDoc (Apache-2.0). The models it uses are other
people's: Infinity-Parser2-Flash and -Pro (infly), olmOCR-2-7B-1025 (allenai), docling-layout-heron
(docling-project), all Apache-2.0.

**olmOCR-bench, run 97: 86.8** (95% bootstrap CI 86.0-87.7), official scorer, all eight sections,
dataset revision `54a96a6f`. [RESULTS.md](RESULTS.md) has the section scores, exactly what read which pages, and
how to re-score the 1,403 outputs in `outputs/` yourself.

The arrangement, in one line: the PDF's own text for the 1,122 pages that have it (no model), Infinity-Parser2-Flash
for the 281 that do not, Infinity-Parser2-Pro behind it for the 102 the pipeline's own OCR cannot read, olmOCR 2
for 92 picture regions; readings recorded on a rented GPU and replayed; no post-processing keyed on the
benchmark's folder names.