Hugging Face's logo

sh0ck0r
/
llama-3.1-70b-instruct-FP8-Dynamic

Text Generation
Transformers
Safetensors
llama
fp8
vllm
compressed-tensors
quantized
llmcompressor
conversational
text-generation-inference
Model card Files
xet
Community
llama-3.1-70b-instruct-FP8-Dynamic / tokenizer.json

Commit History

Upload FP8 quantized version of meta-llama/Llama-3.1-70B-Instruct
ef33b4f
verified

sh0ck0r commited on