Azaz666
/

Qwen2.5-VL-7B-Instruct-INT4-quantized

Model card Files Files and versions

Qwen2.5-VL-7B-Instruct-INT4-quantized

16.6 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

Azaz666's picture

INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16)

544728e verified 2 months ago

.gitattributes

1.57 kB
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
chat_template.jinja

1.02 kB
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
config.json

2.37 kB
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
generation_config.json

213 Bytes
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
model.safetensors

16.6 GB
xet

INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
processor_config.json

1.42 kB
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
quantization_config.json

401 Bytes
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
tokenizer.json

11.4 MB
xet

INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago
tokenizer_config.json

709 Bytes
INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct (LLM backbone quantized, vision encoder fp16) 2 months ago