shuttleai
/

shuttle-3-mini-GPTQ-Int4

Text Generation

text-generation-inference

Model card Files Files and versions

shuttle-3-mini-GPTQ-Int4

10 GB

1 contributor

History: 5 commits

xtristan's picture

Upload quantize_config.json

c523809 verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
5.17 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False over 1 year ago
config.json
725 Bytes

Update config.json over 1 year ago
generation_config.json
248 Bytes

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False over 1 year ago
model-00001-of-00002.safetensors
4.99 GB
xet

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False over 1 year ago
model-00002-of-00002.safetensors
4.99 GB
xet

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False over 1 year ago
model.safetensors.index.json
129 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False over 1 year ago
quantize_config.json
265 Bytes

Upload quantize_config.json over 1 year ago
special_tokens_map.json
613 Bytes

Upload 4 files over 1 year ago
tokenizer.json
7.03 MB

Upload 4 files over 1 year ago
tokenizer_config.json
4.97 kB

Upload 4 files over 1 year ago