Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
tokenlabsdotrun
/
Llama-3.1-8B-Quanto-Int8
like
0
Follow
tokenlabs.run
1
Text Generation
Transformers
Safetensors
llama
quantized
quanto
int8
conversational
text-generation-inference
8-bit precision
License:
llama3.1
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Llama-3.1-8B-Quanto-Int8
8.58 GB
1 contributor
History:
3 commits
genai2eliza
Upload Llama-3.1-8B quantized with quanto int8
105dfa7
verified
8 days ago
.gitattributes
1.57 kB
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
README.md
1.55 kB
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
chat_template.jinja
4.61 kB
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
config.json
868 Bytes
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
model.safetensors
8.56 GB
xet
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
special_tokens_map.json
296 Bytes
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
tokenizer.json
17.2 MB
xet
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
tokenizer_config.json
50.5 kB
Upload Llama-3.1-8B quantized with quanto int8
8 days ago
