Run with:

vllm serve leon-se/Qwen2.5-VL-32B-Instruct-FP8-Dynamic
Downloads last month
60
Safetensors
Model size
33B params
Tensor type
BF16
ยท
F8_E4M3
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for leon-se/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Quantized
(30)
this model