Maximofn
/

Llama-3-8B-Instruct-GPTQ-4bits

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Llama-3-8B-Instruct-GPTQ-4bits

5.74 GB

1 contributor

History: 4 commits

Maximofn's picture

Tokenizers for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False

7560004 verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
5.17 kB

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
config.json
1.33 kB

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
generation_config.json
194 Bytes

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
model-00001-of-00002.safetensors
4.68 GB
xet

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
model-00002-of-00002.safetensors
1.05 GB
xet

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
model.safetensors.index.json
78.5 kB

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
special_tokens_map.json
296 Bytes

Tokenizers for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
tokenizer.json
9.09 MB

Tokenizers for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago
tokenizer_config.json
51 kB

Tokenizers for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False over 1 year ago