Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
int8
vllm
quantized
8-bit precision
text-generation-inference
compressed-tensors
Model card Files
xet
Community
2
alexmarques commited on
Commit
043563b
·
verified ·
1 Parent(s): 82e54a3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -2,6 +2,7 @@
2
  tags:
3
  - int8
4
  - vllm
 
5
  language:
6
  - en
7
  - de
 
2
  tags:
3
  - int8
4
  - vllm
5
+ - quantized
6
  language:
7
  - en
8
  - de