Upload README.md
Browse files
README.md
CHANGED
|
@@ -1,11 +1,11 @@
|
|
| 1 |
# Introduction
|
| 2 |
|
| 3 |
-
DeepSeek-R1-INT4-FlagOS-Iluvatar provides an all-in-one deployment solution, enabling execution of DeepSeek-R1-INT4 on Iluvatar GPUs. As the first-generation release for the ILUVATAR
|
| 4 |
|
| 5 |
1. Comprehensive Integration:
|
| 6 |
- Integrated with FlagScale (https://github.com/FlagOpen/FlagScale).
|
| 7 |
- Open-source inference execution code, preconfigured with all necessary software and hardware settings.
|
| 8 |
-
- Pre-built Docker image for rapid deployment on ILUVATAR
|
| 9 |
2. Consistency Validation:
|
| 10 |
- Evaluation tests verifying consistency of results between the official and ours.
|
| 11 |
|
|
@@ -93,9 +93,10 @@ Requested by Iluvatar, the file of docker image and model files should be applie
|
|
| 93 |
```bash
|
| 94 |
|
| 95 |
pip install modelscope
|
| 96 |
-
modelscope download --model
|
| 97 |
|
| 98 |
```
|
|
|
|
| 99 |
|
| 100 |
### Download the FlagOS image
|
| 101 |
|
|
@@ -106,7 +107,7 @@ docker pull baai_v4
|
|
| 106 |
### Start the inference service
|
| 107 |
|
| 108 |
```bash
|
| 109 |
-
docker run --shm-size="32g" -itd -v /dev:/dev -v /usr/src/:/usr/src -v /lib/modules/:/lib/modules -v /home:/home -v /mnt/share/:/data1 --privileged --cap-add=ALL --pid=host --net=host --name baai_v4 baai:v4
|
| 110 |
|
| 111 |
docker exec -it baai_v4 bash
|
| 112 |
```
|
|
@@ -162,5 +163,5 @@ send "FlagRelease"
|
|
| 162 |
|
| 163 |
# License
|
| 164 |
|
| 165 |
-
|
| 166 |
|
|
|
|
| 1 |
# Introduction
|
| 2 |
|
| 3 |
+
DeepSeek-R1-INT4-FlagOS-Iluvatar provides an all-in-one deployment solution, enabling execution of DeepSeek-R1-INT4 on Iluvatar GPUs. As the first-generation release for the ILUVATAR, this package delivers three key features:
|
| 4 |
|
| 5 |
1. Comprehensive Integration:
|
| 6 |
- Integrated with FlagScale (https://github.com/FlagOpen/FlagScale).
|
| 7 |
- Open-source inference execution code, preconfigured with all necessary software and hardware settings.
|
| 8 |
+
- Pre-built Docker image for rapid deployment on ILUVATAR.
|
| 9 |
2. Consistency Validation:
|
| 10 |
- Evaluation tests verifying consistency of results between the official and ours.
|
| 11 |
|
|
|
|
| 93 |
```bash
|
| 94 |
|
| 95 |
pip install modelscope
|
| 96 |
+
modelscope download --model deepseek-ai/DeepSeek-R1 --local_dir /nfs/DeepSeek-R1
|
| 97 |
|
| 98 |
```
|
| 99 |
+
contact services@iluvatar.comContact to obtain the quanted weights
|
| 100 |
|
| 101 |
### Download the FlagOS image
|
| 102 |
|
|
|
|
| 107 |
### Start the inference service
|
| 108 |
|
| 109 |
```bash
|
| 110 |
+
docker run --shm-size="32g" -itd -v /dev:/dev -v /usr/src/:/usr/src -v /lib/modules/:/lib/modules -v /home:/home -v /nfs:/nfs -v /mnt/share/:/data1 --privileged --cap-add=ALL --pid=host --net=host --name baai_v4 baai:v4
|
| 111 |
|
| 112 |
docker exec -it baai_v4 bash
|
| 113 |
```
|
|
|
|
| 163 |
|
| 164 |
# License
|
| 165 |
|
| 166 |
+
The weights of this model are based on deepseek-ai/DeepSeek-R1 and are open-sourced under the Apache 2.0 License: https://www.apache.org/licenses/LICENSE-2.0.txt.
|
| 167 |
|