RedHatAI
/

Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

alexmarques commited on Jul 12, 2024

Commit

10fb995

·

verified ·

1 Parent(s): cdc8862

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ pipeline_tag: text-generation
   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**
-  - **Quantized:** INT8 weights
 - **Release Date:** 7/2/2024
 - **Version:** 1.0
 - **Model Developers:** Neural Magic

   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**
+  - **Weight quantization:** INT8
 - **Release Date:** 7/2/2024
 - **Version:** 1.0
 - **Model Developers:** Neural Magic