---
library_name: transformers
tags:
- vision-language
- document-understanding
- boundingdocs
- bitsandbytes
- 8-bit
---

# CompressingVLM/glm-ocr-boundingdocs-ft-bnb-int8

Source model: `/content/dce_checkpoints/gaycor/base_glm_ocr_unquantized`

Quantization: bitsandbytes 8-bit.

Model kind: `gaycor_tit GLM-OCR LoRA fine-tuned checkpoint-8000`

This repository stores a PEFT adapter plus quantization metadata. Load the base model with the included BitsAndBytesConfig and then apply the adapter.

The accompanying notebooks evaluate with the same branch metrics used before quantization:
ANLS, spatial precision/recall/F1, `ANLS * Spatial F1`, and bbox coverage. For the Qwen distilled model they also report value exact/contains match.