| ---
|
| license: mit
|
| library_name: transformers
|
| pipeline_tag: image-to-text
|
| base_model: breezedeus/pix2text-mfr-1.5
|
| base_model_relation: finetune
|
| tags:
|
| - typst
|
| - math-ocr
|
| - formula-recognition
|
| - onnx
|
| - vision-encoder-decoder
|
| - browser
|
| ---
|
|
|
| # TypLens-V1
|
|
|
| **A small image-to-Typst model for printed formula screenshots.** It generates
|
| native Typst formula text directly and can run entirely in a browser.
|
|
|
| This is a separate model release from [IBEM-im2typst](https://huggingface.co/dbcccc/IBEM-im2typst).
|
| It uses the best current native SX checkpoint, not the latest experimental run.
|
| This is an **experimental weights-only release**; training code is not included.
|
|
|
| | Format | Location | Model file size |
|
| | --- | --- | ---: |
|
| | Full precision, FP32 | model.safetensors | 117.7 MB |
|
| | Full precision, cached ONNX | onnx/fp32/ | 118.0 MB |
|
| | Compact, INT8 weight quantization | onnx/int8/ | 33.9 MB |
|
|
|
| Sizes use decimal MB and exclude configuration and the consuming application's
|
| runtime. The compact variant is 71.3% smaller than the full ONNX variant.
|
| All variants share the same 29,403,264-parameter source checkpoint.
|
|
|
| ## Intended use
|
|
|
| Input: a single tightly cropped, dark-on-light printed mathematical formula,
|
| such as a PDF or paper screenshot. Output: native Typst math content. This is
|
| formula recognition, not document conversion, page layout detection or general OCR.
|
| The tokenizer, byte mapping and preprocessing configuration are required assets.
|
|
|
| Use the full ONNX variant for best reviewed quality or the INT8 variant for a
|
| smaller download. See [INFERENCE.md](INFERENCE.md) for the input, cache and decoding
|
| contract. The graphs run in ONNX Runtime; the package does not bundle runtime
|
| libraries or executable inference/training source.
|
|
|
| ## Existing development results
|
|
|
| | Measure | Full precision | Compact |
|
| | --- | ---: | ---: |
|
| | Paper screenshots correct in content and symbol style | 38/47 (80.9%) | 38/47 (80.9%) |
|
| | Other validation formulas correct in content and symbol style | 128/135 (94.8%) | 127/135 (94.1%) |
|
| | Generation ended normally | 182/182 | 181/182 |
|
| | Desktop browser median inference | 399 ms | 332 ms |
|
| | Desktop browser P95 inference | 662 ms | 602 ms |
|
|
|
| The results above come from the existing September 16, 2026 browser experiment,
|
| using Chromium 152 on Windows with four WASM threads. Time excludes preprocessing,
|
| model initialization and network download. It is not a promise for other devices.
|
| The same development examples were used repeatedly, and content/style judgments
|
| were made by one Codex reviewer, without an independent second reviewer. These
|
| are **not independent test accuracy** and are not comparable to the old release's
|
| 92.63% strict text score on its different IBEM validation set.
|
|
|
| The compact model failed to terminate on one validation example. Both variants
|
| can produce mathematically wrong formulas, even when their Typst compiles.
|
| Long expressions, subscripts, symbols and style distinctions remain error sources.
|
| The checkpoint has not passed the project's existing release-quality gate;
|
| publishing it as experimental does not change that result. Review outputs.
|
|
|
| ## Model and data provenance
|
|
|
| Base: Pix2Text-MFR-1.5, revision
|
| `1cef9f0bdcd6a4c63df7de1311fb0894593340cc`, adapted to native Typst targets.
|
| The screenshot-adaptation stage used 268,346 training pairs drawn from UniMER
|
| and IBEM. Source LaTeX annotations were used in data preparation; the released
|
| model generates Typst directly and has no inference-time conversion bridge.
|
|
|
| Source checkpoint SHA-256:
|
| `900938e6cca81d62448fa8693a78a42d91aeea328b998887da7f1d65d7b11258`.
|
| Version: **v1**. This release renames and packages the existing weights;
|
| it does not retrain, merge, or otherwise change them.
|
|
|
| ## License
|
|
|
| MIT for the released project contributions, with the upstream MIT notices
|
| retained. See [LICENSE](LICENSE), [NOTICE.md](NOTICE.md), and `licenses/`.
|
| Training datasets retain their own terms and are not included. The model license
|
| does not provide rights to third-party images or annotations.
|
|
|
