RedHatAI
/

Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Meta-Llama-3-8B-Instruct-quantized.w4a16

5.74 GB

2 contributors

History: 13 commits

alexmarques's picture

Update README.md

6bf4ded verified over 1 year ago

.gitattributes
1.52 kB

initial commit over 1 year ago
README.md
7.61 kB

Update README.md over 1 year ago
config.json
1.05 kB

Upload config.json with huggingface_hub over 1 year ago
model.safetensors
5.73 GB
xet

Upload model.safetensors with huggingface_hub over 1 year ago
quantize_config.json
269 Bytes

Upload quantize_config.json with huggingface_hub over 1 year ago
special_tokens_map.json
296 Bytes

Upload special_tokens_map.json with huggingface_hub over 1 year ago
tokenizer.json
9.09 MB

Upload tokenizer.json with huggingface_hub over 1 year ago
tokenizer_config.json
51 kB

Upload tokenizer_config.json with huggingface_hub over 1 year ago