File size: 1,563 Bytes
205395b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 | ---
license: gpl-3.0
library_name: candle
pipeline_tag: image-to-text
tags:
- candle
- ocr
- image-to-text
- manga
- comic
- multilingual
- safetensors
---
# MIT 48px OCR
A SafeTensors conversion of the 48-pixel OCR model used by [`zyddnys/manga-image-translator`](https://github.com/zyddnys/manga-image-translator) and BallonsTranslator. The model recognizes cropped comic text lines and also predicts foreground and background colors.
## Model details
- Input text height: 48 pixels
- Maximum configured width: 8100 pixels
- Visual backbone: ConvNeXt feature extractor
- Sequence model: four-layer Transformer encoder and five-layer Transformer decoder
- Embedding dimension: 320
- Attention heads: 4
- Default beam size: 5
- Default maximum sequence length: 255
## Files
- `model.safetensors`: converted model weights
- `config.json`: architecture and decoding configuration
- `alphabet-all-v7.txt`: tokenizer alphabet and special-token vocabulary
Token IDs are `0` for padding, `1` for beginning-of-sequence, and `2` for end-of-sequence. `<SP>` represents a space.
## Intended use and limitations
The model expects already detected, cropped, and normalized comic text regions. It does not locate text on a page. Recognition quality depends strongly on crop quality, text scale, language coverage in the supplied alphabet, and image degradation. Training data details and evaluation metrics are not included with this conversion.
## License
GPL-3.0, following the upstream manga-image-translator and BallonsTranslator implementations.
|