AlaBoussoffara's picture
Upload 8-bit quantized artifacts
33333e8 verified
|
Raw
History Blame Contribute Delete
741 Bytes
metadata
library_name: transformers
tags:
  - vision-language
  - document-understanding
  - boundingdocs
  - bitsandbytes
  - 8-bit

CompressingVLM/glm-ocr-boundingdocs-ft-bnb-int8

Source model: /content/dce_checkpoints/gaycor/base_glm_ocr_unquantized

Quantization: bitsandbytes 8-bit.

Model kind: gaycor_tit GLM-OCR LoRA fine-tuned checkpoint-8000

This repository stores a PEFT adapter plus quantization metadata. Load the base model with the included BitsAndBytesConfig and then apply the adapter.

The accompanying notebooks evaluate with the same branch metrics used before quantization: ANLS, spatial precision/recall/F1, ANLS * Spatial F1, and bbox coverage. For the Qwen distilled model they also report value exact/contains match.