YummyYum commited on
Commit
9f9b3fc
·
verified ·
1 Parent(s): 6b7b0a5

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -1,11 +1,11 @@
1
  # Introduction
2
 
3
- DeepSeek-R1-INT4-FlagOS-Iluvatar provides an all-in-one deployment solution, enabling execution of DeepSeek-R1-INT4 on Iluvatar GPUs. As the first-generation release for the ILUVATAR-BI150, this package delivers three key features:
4
 
5
  1. Comprehensive Integration:
6
  - Integrated with FlagScale (https://github.com/FlagOpen/FlagScale).
7
  - Open-source inference execution code, preconfigured with all necessary software and hardware settings.
8
- - Pre-built Docker image for rapid deployment on ILUVATAR-BI150.
9
  2. Consistency Validation:
10
  - Evaluation tests verifying consistency of results between the official and ours.
11
 
@@ -93,9 +93,10 @@ Requested by Iluvatar, the file of docker image and model files should be applie
93
  ```bash
94
 
95
  pip install modelscope
96
- modelscope download --model <Model Name> --local_dir <Cache Path>
97
 
98
  ```
 
99
 
100
  ### Download the FlagOS image
101
 
@@ -106,7 +107,7 @@ docker pull baai_v4
106
  ### Start the inference service
107
 
108
  ```bash
109
- docker run --shm-size="32g" -itd -v /dev:/dev -v /usr/src/:/usr/src -v /lib/modules/:/lib/modules -v /home:/home -v /mnt/share/:/data1 --privileged --cap-add=ALL --pid=host --net=host --name baai_v4 baai:v4
110
 
111
  docker exec -it baai_v4 bash
112
  ```
@@ -162,5 +163,5 @@ send "FlagRelease"
162
 
163
  # License
164
 
165
- This project and related model weights are licensed under the MIT License.
166
 
 
1
  # Introduction
2
 
3
+ DeepSeek-R1-INT4-FlagOS-Iluvatar provides an all-in-one deployment solution, enabling execution of DeepSeek-R1-INT4 on Iluvatar GPUs. As the first-generation release for the ILUVATAR, this package delivers three key features:
4
 
5
  1. Comprehensive Integration:
6
  - Integrated with FlagScale (https://github.com/FlagOpen/FlagScale).
7
  - Open-source inference execution code, preconfigured with all necessary software and hardware settings.
8
+ - Pre-built Docker image for rapid deployment on ILUVATAR.
9
  2. Consistency Validation:
10
  - Evaluation tests verifying consistency of results between the official and ours.
11
 
 
93
  ```bash
94
 
95
  pip install modelscope
96
+ modelscope download --model deepseek-ai/DeepSeek-R1 --local_dir /nfs/DeepSeek-R1
97
 
98
  ```
99
+ contact services@iluvatar.comContact to obtain the quanted weights
100
 
101
  ### Download the FlagOS image
102
 
 
107
  ### Start the inference service
108
 
109
  ```bash
110
+ docker run --shm-size="32g" -itd -v /dev:/dev -v /usr/src/:/usr/src -v /lib/modules/:/lib/modules -v /home:/home -v /nfs:/nfs -v /mnt/share/:/data1 --privileged --cap-add=ALL --pid=host --net=host --name baai_v4 baai:v4
111
 
112
  docker exec -it baai_v4 bash
113
  ```
 
163
 
164
  # License
165
 
166
+ The weights of this model are based on deepseek-ai/DeepSeek-R1 and are open-sourced under the Apache 2.0 License: https://www.apache.org/licenses/LICENSE-2.0.txt.
167