Jimmy1229
/

Llama-3.2-3B-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Llama-3.2-3B-4bit

3.06 GB

1 contributor

History: 3 commits

Jimmy1229's picture

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False

a3d67d1 verified 12 months ago

.gitattributes
1.57 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
README.md
5.17 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
config.json
1.24 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
model.safetensors
3.05 GB
xet

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
quantize_config.json
266 Bytes

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
special_tokens_map.json
301 Bytes

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
tokenizer.json
17.2 MB
xet

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago
tokenizer_config.json
50.5 kB

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False 12 months ago