Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -21,7 +21,7 @@ tags:
21
  - facebook
22
  - meta
23
  - llama-3
24
- - int8
25
  - vllm
26
  - chat
27
  - neuralmagic
@@ -31,9 +31,9 @@ tags:
31
  - compressed-tensors
32
  license: llama3.1
33
  license_name: llama3.1
34
- name: RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
35
- description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to INT8 data type.
36
- readme: https://huggingface.co/RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8/main/README.md
37
  tasks:
38
  - text-to-text
39
  - tool-calling
 
21
  - facebook
22
  - meta
23
  - llama-3
24
+ - fp8
25
  - vllm
26
  - chat
27
  - neuralmagic
 
31
  - compressed-tensors
32
  license: llama3.1
33
  license_name: llama3.1
34
+ name: RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
35
+ description: This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-8B-Instruct to FP8 data type.
36
+ readme: https://huggingface.co/RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic/main/README.md
37
  tasks:
38
  - text-to-text
39
  - tool-calling