poolside
/

Laguna-M.1-FP8

Text Generation

Mixture of Experts

compressed-tensors

Model card Files Files and versions

Update README.md

#4

by Jiminator - opened 10 days ago

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -117,8 +117,7 @@ sglang serve \
     --tool-call-parser poolside_v1 \
     --tp 8 \
     --host 0.0.0.0 \
-    --port 30000 \
-    --fp8-gemm-backend triton # Needed for SM100
 ```
 #### TRT-LLM

     --tool-call-parser poolside_v1 \
     --tp 8 \
     --host 0.0.0.0 \
+    --port 30000
 ```
 #### TRT-LLM