RedHatAI
/

Llama-2-7b-chat-quantized.w8a8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

Llama-2-7b-chat-quantized.w8a8

Commit History

Updated compression_config to quantization_config

ba2ce26
verified

mgoin commited on Oct 9, 2024

Update README.md

bd091ad
verified

alexmarques commited on Jul 18, 2024

Update README.md

fc3cda7
verified

alexmarques commited on Jul 18, 2024

Update README.md

5b46bd1
verified

alexmarques commited on Jul 18, 2024

Create README.md

ce7108c
verified

alexmarques commited on Jul 17, 2024

Upload folder using huggingface_hub

9ef720f
verified

alexmarques commited on Jul 11, 2024

initial commit

d0b6bc0
verified

alexmarques commited on Jul 11, 2024