Update README.md
Browse files
README.md
CHANGED
|
@@ -67,21 +67,21 @@ FlagEval (Libra)** is a comprehensive evaluation system and open platform for la
|
|
| 67 |
|
| 68 |
```bash
|
| 69 |
pip install modelscope
|
| 70 |
-
modelscope download --model
|
| 71 |
|
| 72 |
```
|
| 73 |
|
| 74 |
### Download FlagOS Image
|
| 75 |
|
| 76 |
```bash
|
| 77 |
-
docker pull harbor.baai.ac.cn/flagrelease-public/
|
| 78 |
```
|
| 79 |
|
| 80 |
### Start the inference service
|
| 81 |
|
| 82 |
```bash
|
| 83 |
#Container Startup
|
| 84 |
-
docker run --rm --init --detach --net=host --uts=host --ipc=host --security-opt=seccomp=unconfined --privileged=true --ulimit stack=67108864 --ulimit memlock=-1 --ulimit nofile=1048576:1048576 --shm-size=32G -v /share:/share --gpus all --name flagos harbor.baai.ac.cn/flagrelease-public/
|
| 85 |
```
|
| 86 |
|
| 87 |
### Serve
|
|
|
|
| 67 |
|
| 68 |
```bash
|
| 69 |
pip install modelscope
|
| 70 |
+
modelscope download --model FlagRelease/Seed-OSS-36B-Instruct-FlagOS --local_dir /share/models/Seed-OSS-36B-Instruct
|
| 71 |
|
| 72 |
```
|
| 73 |
|
| 74 |
### Download FlagOS Image
|
| 75 |
|
| 76 |
```bash
|
| 77 |
+
docker pull harbor.baai.ac.cn/flagrelease-public/flagrelease-nvidia-release-model_seed-oss-36b-instruct-tree_none-gems_3.0-scale_0.8.0-cx_none-python_3.12.3-torch_2.8.0-pcp_cuda12.9-gpu_nvidia004-arc_amd64-driver_535.183.06:2509111457
|
| 78 |
```
|
| 79 |
|
| 80 |
### Start the inference service
|
| 81 |
|
| 82 |
```bash
|
| 83 |
#Container Startup
|
| 84 |
+
docker run --rm --init --detach --net=host --uts=host --ipc=host --security-opt=seccomp=unconfined --privileged=true --ulimit stack=67108864 --ulimit memlock=-1 --ulimit nofile=1048576:1048576 --shm-size=32G -v /share:/share --gpus all --name flagos harbor.baai.ac.cn/flagrelease-public/flagrelease-nvidia-release-model_seed-oss-36b-instruct-tree_none-gems_3.0-scale_0.8.0-cx_none-python_3.12.3-torch_2.8.0-pcp_cuda12.9-gpu_nvidia004-arc_amd64-driver_535.183.06:2509111457 sleep infinity
|
| 85 |
```
|
| 86 |
|
| 87 |
### Serve
|