Update README.md
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ Read more about how the model is trained and evaluted in our [technical report](
|
|
| 28 |
|
| 29 |
# Usage: Serve with SGLang
|
| 30 |
```bash
|
| 31 |
-
python -m sglang.launch_server --model-path
|
| 32 |
```
|
| 33 |
This would require two GPUs with 80G VRAM. Alternatively, you may serve with 4 GPUs with 40G VRAM via `--tp 4`.
|
| 34 |
|
|
|
|
| 28 |
|
| 29 |
# Usage: Serve with SGLang
|
| 30 |
```bash
|
| 31 |
+
python -m sglang.launch_server --model-path biomni/Biomni-R0-32B-Preview --port 30000 --host 0.0.0.0 --mem-fraction-static 0.8 --tp 2 --trust-remote-code --json-model-override-args '{"rope_scaling":{"rope_type":"yarn","factor":1.0,"original_max_position_embeddings":32768}, "max_position_embeddings": 131072}'
|
| 32 |
```
|
| 33 |
This would require two GPUs with 80G VRAM. Alternatively, you may serve with 4 GPUs with 40G VRAM via `--tp 4`.
|
| 34 |
|