Meteonis commited on
Commit
65f8a0f
·
verified ·
1 Parent(s): 1a6f01e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -0
README.md CHANGED
@@ -122,6 +122,49 @@ python -m sglang.launch_server \
122
  --mamba-scheduler-strategy extra_buffer
123
  ```
124
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
125
  ### Recommended Sampling Parameters
126
 
127
  For the best generation quality, we recommend the following sampling parameters:
 
122
  --mamba-scheduler-strategy extra_buffer
123
  ```
124
 
125
+ ### Docker Deployment
126
+
127
+ We also provide a prebuilt Docker image with our customized `sglang` fork preinstalled: **`nexagi/sglang:v0.5.12`**. The launch command is the same as above.
128
+
129
+ #### Nex-N2-Pro
130
+
131
+ ```bash
132
+ # Multi-node (2 nodes). Run the same command on every node with:
133
+ # <node-rank> = 0 on the head node, 1 on the other node
134
+ # <node0-ip> = IP of the head node (reachable from all others)
135
+ docker run --gpus all --shm-size 32g --network host \
136
+ -v /path/to/your/model:/model \
137
+ nexagi/sglang:v0.5.12 \
138
+ python3 -m sglang.launch_server \
139
+ --model-path /model \
140
+ --tp 16 \
141
+ --nnodes 2 \
142
+ --node-rank <node-rank> \
143
+ --dist-init-addr <node0-ip>:20000 \
144
+ --host 0.0.0.0 --port 30000 \
145
+ --reasoning-parser qwen3 \
146
+ --tool-call-parser qwen3_coder \
147
+ --mamba-scheduler-strategy extra_buffer
148
+ ```
149
+
150
+ #### Nex-N2-mini
151
+
152
+ Single node with 2× H100:
153
+
154
+ ```bash
155
+ docker run --gpus all --shm-size 32g --ipc=host \
156
+ -p 30000:30000 \
157
+ -v /path/to/your/model:/model \
158
+ nexagi/sglang:v0.5.12 \
159
+ python3 -m sglang.launch_server \
160
+ --model-path /model \
161
+ --tp 2 \
162
+ --host 0.0.0.0 --port 30000 \
163
+ --reasoning-parser qwen3 \
164
+ --tool-call-parser qwen3_coder \
165
+ --mamba-scheduler-strategy extra_buffer
166
+ ```
167
+
168
  ### Recommended Sampling Parameters
169
 
170
  For the best generation quality, we recommend the following sampling parameters: