shadowrock-io/Unlimited-OCR-Community-FP8-Dynamic
Image-Text-to-Text • 3B • Updated • 7
FP8 (CER 0.0 vs BF16) and calibrated NVFP4 (mean CER 0.0068) builds, validated under vLLM with evidence shipped in-repo.
Note Near-lossless W8A8: CER 0.0 vs BF16 on the fixture set, grounding boxes included. 6.7 GB -> 3.9 GB.
Note First calibrated 4-bit build: mean CER 0.0068 vs BF16 (data-free community NVFP4 measures 4.27 on the same harness). 6.7 GB -> 2.8 GB.
Note Upstream BF16 base model (rev 07dea832).