lightonocr-GGUF / README.md
cstr's picture
Add model card
915edd0 verified
|
Raw
History Blame Contribute Delete
1.15 kB
---
license: apache-2.0
tags: [gguf, ocr, document-understanding, pixtral, qwen3]
base_model: lightonai/LightOnOCR-2-1B
pipeline_tag: image-to-text
language: [en, de, fr, es, it, pt, nl]
---
# LightOnOCR-2-1B — GGUF
GGUF conversion of [lightonai/LightOnOCR-2-1B](https://huggingface.co/lightonai/LightOnOCR-2-1B) for [CrispEmbed](https://github.com/CrispStrobe/CrispEmbed).
OCR Arena #2 (ELO 1697, 72% win rate). End-to-end document OCR — converts scans, PDFs, and photos to clean markdown.
## Architecture
| Component | Details |
|-----------|---------|
| Vision | Pixtral ViT (24L, 1024d, 2D RoPE, SiLU FFN) |
| Projection | 2×2 spatial merge + 2-layer MLP + RMSNorm |
| Decoder | Qwen3 (28L, 1024d, GQA 16/8, QK norm, SwiGLU) |
| Total | 1006M params |
| License | Apache 2.0 |
## Available Formats
| File | Format | Size |
|------|--------|------|
| `lightonocr-1b-f16.gguf` | F16 | 2218 MB |
| `lightonocr-1b-q8_0.gguf` | Q8_0 | 1025 MB |
| `lightonocr-1b-q4_k.gguf` | Q4_K | 622 MB |
## Usage
```bash
crispembed -m lightonocr-1b-q4_k.gguf --ocr document.png
```
Auto-detected from GGUF architecture metadata (`lightonocr`).