Update README.md
#4
by chambridge - opened
README.md
CHANGED
|
@@ -21,7 +21,7 @@ tags:
|
|
| 21 |
- facebook
|
| 22 |
- meta
|
| 23 |
- llama-3
|
| 24 |
-
-
|
| 25 |
- vllm
|
| 26 |
- chat
|
| 27 |
- neuralmagic
|
|
@@ -31,9 +31,9 @@ tags:
|
|
| 31 |
- compressed-tensors
|
| 32 |
license: llama3.1
|
| 33 |
license_name: llama3.1
|
| 34 |
-
name: RedHatAI/Meta-Llama-3.1-8B-Instruct-
|
| 35 |
-
description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to
|
| 36 |
-
readme: https://huggingface.co/RedHatAI/Meta-Llama-3.1-8B-Instruct-
|
| 37 |
tasks:
|
| 38 |
- text-to-text
|
| 39 |
- tool-calling
|
|
|
|
| 21 |
- facebook
|
| 22 |
- meta
|
| 23 |
- llama-3
|
| 24 |
+
- fp8
|
| 25 |
- vllm
|
| 26 |
- chat
|
| 27 |
- neuralmagic
|
|
|
|
| 31 |
- compressed-tensors
|
| 32 |
license: llama3.1
|
| 33 |
license_name: llama3.1
|
| 34 |
+
name: RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
|
| 35 |
+
description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to FP8 data type.
|
| 36 |
+
readme: https://huggingface.co/RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic/main/README.md
|
| 37 |
tasks:
|
| 38 |
- text-to-text
|
| 39 |
- tool-calling
|