shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

shuttle-2.5-mini-GPTQ-Int4

8.37 GB

1 contributor

History: 5 commits

xtristan's picture

Create README.md

31dd7f5 verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
2.56 kB

Create README.md over 1 year ago
config.json
988 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True over 1 year ago
gptq_model-4bit-128g.safetensors
8.36 GB
xet

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True over 1 year ago
model.safetensors.index.json
187 kB

Upload model.safetensors.index.json with huggingface_hub over 1 year ago
quantize_config.json
265 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True over 1 year ago
special_tokens_map.json
552 Bytes

Tokenizers over 1 year ago
tokenizer.json
9.26 MB

Tokenizers over 1 year ago
tokenizer_config.json
178 kB

Tokenizers over 1 year ago