robgreenberg3 commited on
Commit
4fd84f6
·
verified ·
1 Parent(s): 872ee4a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -1,14 +1,22 @@
1
- ---
 
 
 
2
  tags:
3
  - w8a8
4
  - int8
5
  - vllm
 
 
6
  license: apache-2.0
7
- license_link: https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md
8
- language:
9
- - en
10
- base_model: ibm-granite/granite-3.1-8b-instruct
11
- library_name: transformers
 
 
 
12
  ---
13
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
14
  granite-3.1-8b-instruct-quantized.w8a8
 
1
+ language:
2
+ - en
3
+ base_model: ibm-granite/granite-3.1-8b-instruct
4
+ pipeline_tag: text-generation
5
  tags:
6
  - w8a8
7
  - int8
8
  - vllm
9
+ - conversational
10
+ - text-generation-inference
11
  license: apache-2.0
12
+ license_name: apache-2.0
13
+ name: RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
14
+ description: This model was obtained by quantizing the weights and activations of ibm-granite/granite-3.1-8b-instruct to INT8 data type.
15
+ readme: https://huggingface.co/RedHatAI/granite-3.1-8b-instruct-quantized.w8a8/main/README.md
16
+ tasks:
17
+ - text-to-text
18
+ provider: IBM
19
+ license_link: https://www.apache.org/licenses/LICENSE-2.0
20
  ---
21
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
22
  granite-3.1-8b-instruct-quantized.w8a8