robgreenberg3 commited on
Commit
16d3c9f
·
verified ·
1 Parent(s): 49eec88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -4
README.md CHANGED
@@ -1,14 +1,27 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
  - en
 
 
 
5
  tags:
6
  - mistral
7
  - mistral-small
8
- - int8
 
9
  - vllm
10
- base_model: mistralai/Mistral-Small-24B-Instruct-2501
11
- library_name: transformers
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
 
1
  ---
 
2
  language:
3
  - en
4
+ base_model:
5
+ - mistralai/Mistral-Small-24B-Instruct-2501
6
+ pipeline_tag: text-generation
7
  tags:
8
  - mistral
9
  - mistral-small
10
+ - w4a16
11
+ - int4
12
  - vllm
13
+ - conversational
14
+ - text-generation-inference
15
+ - compressed-tensors
16
+ license: apache-2.0
17
+ license_name: apache-2.0
18
+ name: RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16
19
+ description: This model was obtained by quantizing the weights of Mistral-Small-24B-Instruct-2501 to INT4 data type.
20
+ readme: https://huggingface.co/RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16/main/README.md
21
+ tasks:
22
+ - text-to-text
23
+ provider: Mistral AI
24
+ license_link: https://www.apache.org/licenses/LICENSE-2.0
25
  ---
26
 
27
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">