Hugging Face's logo

lsm0729
/
Qwen2.5-VL-3B-Instruct-quantized.w8a8

Image-Text-to-Text
Transformers
Safetensors
qwen2_5_vl
quantized
int8
w8a8
vllm
compressed-tensors
vision-language
conversational
text-generation-inference
8-bit precision
Model card Files
xet
Community
Qwen2.5-VL-3B-Instruct-quantized.w8a8 / preprocessor_config.json

Commit History

Upload W8A8 quantized Qwen2.5-VL-3B-Instruct model
f50cc4e
verified

lsm0729 commited on