Update README.md
Browse files
README.md
CHANGED
|
@@ -76,13 +76,13 @@ FlagEval (Libra)** is a comprehensive evaluation system and open platform for la
|
|
| 76 |
|
| 77 |
```python
|
| 78 |
pip install modelscope
|
| 79 |
-
modelscope download --model
|
| 80 |
```
|
| 81 |
|
| 82 |
### Download FlagOS Image
|
| 83 |
|
| 84 |
```python
|
| 85 |
-
docker pull
|
| 86 |
```
|
| 87 |
|
| 88 |
### Start the inference service
|
|
@@ -97,10 +97,10 @@ docker run --rm --init --detach \
|
|
| 97 |
--ulimit memlock=-1 \
|
| 98 |
--ulimit nofile=1048576:1048576 \
|
| 99 |
--shm-size=32G \
|
| 100 |
-
-v /
|
| 101 |
--gpus all \
|
| 102 |
--name flagos \
|
| 103 |
-
|
| 104 |
sleep infinity
|
| 105 |
|
| 106 |
docker exec -it flagos bash
|
|
@@ -168,7 +168,7 @@ for item in response:
|
|
| 168 |
### Q1: What should I do if the model fails to load?
|
| 169 |
|
| 170 |
- Check if the model weight path is correct.
|
| 171 |
-
- Ensure the
|
| 172 |
- Check the container logs: `docker logs flagos`.
|
| 173 |
|
| 174 |
### Q2: API call returns a timeout error. What should I do?
|
|
|
|
| 76 |
|
| 77 |
```python
|
| 78 |
pip install modelscope
|
| 79 |
+
modelscope download --model FlagRelease/RoboBrain2.0-7B-FlagOS --local_dir /data/RoboBrain2.0-7B
|
| 80 |
```
|
| 81 |
|
| 82 |
### Download FlagOS Image
|
| 83 |
|
| 84 |
```python
|
| 85 |
+
docker pull harbor.baai.ac.cn/flagrelease-public/flagrelease-nvidia-release-model_minimax-m2-tree_none-gems_3.0-scale_0.8.0-cx_none-python_3.12.3-torch_2.8.0a0_5228986c39.nv25.6-pcp_cuda12.9-gpu_nvidia003-arc_amd64-driver_570.158.01:2511041437
|
| 86 |
```
|
| 87 |
|
| 88 |
### Start the inference service
|
|
|
|
| 97 |
--ulimit memlock=-1 \
|
| 98 |
--ulimit nofile=1048576:1048576 \
|
| 99 |
--shm-size=32G \
|
| 100 |
+
-v /data:/share/models \
|
| 101 |
--gpus all \
|
| 102 |
--name flagos \
|
| 103 |
+
harbor.baai.ac.cn/flagrelease-public/flagrelease-nvidia-release-model_minimax-m2-tree_none-gems_3.0-scale_0.8.0-cx_none-python_3.12.3-torch_2.8.0a0_5228986c39.nv25.6-pcp_cuda12.9-gpu_nvidia003-arc_amd64-driver_570.158.01:2511041437 \
|
| 104 |
sleep infinity
|
| 105 |
|
| 106 |
docker exec -it flagos bash
|
|
|
|
| 168 |
### Q1: What should I do if the model fails to load?
|
| 169 |
|
| 170 |
- Check if the model weight path is correct.
|
| 171 |
+
- Ensure the model files are present in the `/share/models` directory inside the container.
|
| 172 |
- Check the container logs: `docker logs flagos`.
|
| 173 |
|
| 174 |
### Q2: API call returns a timeout error. What should I do?
|