Jimmy1229
/

Llama-3.2-3B-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Llama-3.2-3B-8bit

4.48 GB

1 contributor

History: 3 commits

Jimmy1229's picture

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False

2af158c verified 12 months ago

.gitattributes
1.57 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
README.md
5.17 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
config.json
1.24 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
model.safetensors
4.47 GB
xet

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
quantize_config.json
266 Bytes

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
special_tokens_map.json
301 Bytes

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
tokenizer.json
17.2 MB
xet

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago
tokenizer_config.json
50.5 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 8 bits, gr128, desc_act=False 12 months ago