lukealonso
/

MiniMax-M2.5-NVFP4

8-bit precision

Model card Files Files and versions

lukealonso commited on Apr 12

Commit

b7efeaa

·

verified ·

1 Parent(s): 1e0ec7a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -69,7 +69,7 @@ python3 -m sglang.launch_server \
   --tool-call-parser minimax-m2 \
   --enable-torch-compile \
   --trust-remote-code \
-  --tp 2 --ep 2 \
   --mem-fraction-static 0.9 \
   --max-running-requests 16 \
   --kv-cache-dtype bf16 # or fp8_e4m3 \

   --tool-call-parser minimax-m2 \
   --enable-torch-compile \
   --trust-remote-code \
+  --tp 2 \
   --mem-fraction-static 0.9 \
   --max-running-requests 16 \
   --kv-cache-dtype bf16 # or fp8_e4m3 \