Maximofn
/

Llama-3-8B-Instruct-GPTQ-3bits

Text Generation

text-generation-inference

Model card Files Files and versions

Llama-3-8B-Instruct-GPTQ-3bits

4.85 GB

1 contributor

History: 2 commits

Maximofn's picture

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False

422fd94 verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
5.17 kB

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False over 1 year ago
config.json
1.33 kB

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False over 1 year ago
generation_config.json
194 Bytes

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False over 1 year ago
model.safetensors
4.85 GB
xet

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False over 1 year ago