rastabastamon
/

phi-3.5-mini-instruct-gptq-4bit

4-bit precision

Model card Files Files and versions

phi-3.5-mini-instruct-gptq-4bit

2.28 GB

1 contributor

History: 2 commits

rastabastamon's picture

Upload 4-bit GPTQ quantized Phi 3.5 Mini Instruct model

cb009f2 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
config.json

270 kB

Upload 4-bit GPTQ quantized Phi 3.5 Mini Instruct model 10 months ago
generation_config.json

172 Bytes

Upload 4-bit GPTQ quantized Phi 3.5 Mini Instruct model 10 months ago
model.safetensors

2.28 GB
xet

Upload 4-bit GPTQ quantized Phi 3.5 Mini Instruct model 10 months ago