Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
solidrust
/
LLama-3.1-8B-Matrix-AWQ
like
1
Follow
SolidRusT Networks
34
Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
text-generation-inference
awq
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
LLama-3.1-8B-Matrix-AWQ
5.74 GB
1 contributor
History:
4 commits
Suparious
Upload quantized AWQ model
64ebf9c
verified
about 1 year ago
.gitattributes
1.52 kB
initial commit
about 1 year ago
README.md
2.83 kB
Update README after successful quantization
about 1 year ago
config.json
1.14 kB
Upload quantized AWQ model
about 1 year ago
generation_config.json
168 Bytes
Upload quantized AWQ model
about 1 year ago
model-00001-of-00002.safetensors
4.68 GB
xet
Upload quantized AWQ model
about 1 year ago
model-00002-of-00002.safetensors
1.05 GB
xet
Upload quantized AWQ model
about 1 year ago
model.safetensors.index.json
63.5 kB
Upload quantized AWQ model
about 1 year ago
special_tokens_map.json
459 Bytes
Upload quantized AWQ model
about 1 year ago
tokenizer.json
9.09 MB
Upload quantized AWQ model
about 1 year ago
tokenizer_config.json
50.6 kB
Upload quantized AWQ model
about 1 year ago