Azaz666
/

Qwen2.5-VL-7B-Instruct-GPTQ-Int4

4-bit precision

Model card Files Files and versions

Qwen2.5-VL-7B-Instruct-GPTQ-Int4

6.94 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

Azaz666's picture

GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct

09207b1 verified 2 months ago

.gitattributes

1.57 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
chat_template.jinja

1.02 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
config.json

3.57 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
generation_config.json

187 Bytes
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
model-00001-of-00002.safetensors

4.28 GB
xet

GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
model-00002-of-00002.safetensors

2.65 GB
xet

GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
model.safetensors.index.json

122 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
processor_config.json

1.42 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
quant_log.csv

9.07 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
quantize_config.json

1 kB
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
tokenizer.json

11.4 MB
xet

GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago
tokenizer_config.json

709 Bytes
GPTQ INT4 quantization of Qwen/Qwen2.5-VL-7B-Instruct 2 months ago