reyvan
/

Qwen-7B-4bit

Text Generation

4-bit precision

Model card Files Files and versions

11.7 GB

1 contributor

History: 3 commits

reyvan's picture

AutoGPTQ model for Qwen/Qwen-7B: 4bits, gr128, desc_act=False

eef18ec verified almost 2 years ago

.gitattributes
1.52 kB

initial commit almost 2 years ago
config.json
1.44 kB

AutoGPTQ model for Qwen/Qwen-7B: 4bits, gr128, desc_act=False almost 2 years ago
gptq_model-4bit-128g.bin
5.86 GB
xet

AutoGPTQ model for Qwen/Qwen-7B: 4bits, gr128, desc_act=False almost 2 years ago
gptq_model-4bit-128g.safetensors
5.86 GB
xet

AutoGPTQ model for Qwen/Qwen-7B: 4bits, gr128, desc_act=False almost 2 years ago
quantize_config.json
294 Bytes

AutoGPTQ model for Qwen/Qwen-7B: 4bits, gr128, desc_act=False almost 2 years ago