joerowell commited on
Commit
d5c0b1f
·
verified ·
1 Parent(s): c630a43

docs: note SGLang support

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -7,6 +7,7 @@ extra_gated_description: >-
7
  tags:
8
  - laguna-m.1
9
  - vllm
 
10
  - bf16
11
  - moe
12
  license: apache-2.0
@@ -86,7 +87,7 @@ Laguna M.1 is a 225B total parameter Mixture-of-Experts model with 23B activated
86
 
87
  ## Usage
88
 
89
- Laguna M.1 has upstream support in vLLM and Transformers, and TRT-LLM thanks to the support of the team at NVIDIA.
90
 
91
  ### pool
92
 
@@ -137,6 +138,10 @@ vllm serve \
137
 
138
  See the [vLLM recipes page](https://recipes.vllm.ai/poolside/Laguna-XS.2) for our Laguna XS.2 model with which the implementation is shared for additional deployment guidance. FP8 and NVFP4 quantized checkpoints are available at [Laguna-M.1-FP8](https://huggingface.co/poolside/Laguna-M.1-FP8) and [Laguna-M.1-NVFP4](https://huggingface.co/poolside/Laguna-M.1-NVFP4); quantization is detected automatically from `quantization_config`, so the same command works with the model ID substituted.
139
 
 
 
 
 
140
  #### Transformers
141
 
142
  Laguna is supported in Transformers `v5.7.0` and later ([huggingface/transformers#45673](https://github.com/huggingface/transformers/pull/45673)).
 
7
  tags:
8
  - laguna-m.1
9
  - vllm
10
+ - sglang
11
  - bf16
12
  - moe
13
  license: apache-2.0
 
87
 
88
  ## Usage
89
 
90
+ Laguna M.1 has upstream support in vLLM, SGLang, and Transformers, and TRT-LLM thanks to the support of the team at NVIDIA.
91
 
92
  ### pool
93
 
 
138
 
139
  See the [vLLM recipes page](https://recipes.vllm.ai/poolside/Laguna-XS.2) for our Laguna XS.2 model with which the implementation is shared for additional deployment guidance. FP8 and NVFP4 quantized checkpoints are available at [Laguna-M.1-FP8](https://huggingface.co/poolside/Laguna-M.1-FP8) and [Laguna-M.1-NVFP4](https://huggingface.co/poolside/Laguna-M.1-NVFP4); quantization is detected automatically from `quantization_config`, so the same command works with the model ID substituted.
140
 
141
+ #### SGLang
142
+
143
+ Laguna M.1 is supported in SGLang via [sgl-project/sglang#28400](https://github.com/sgl-project/sglang/pull/28400). A full serving recipe will be added here; for now, build SGLang from a `main` that includes that PR.
144
+
145
  #### Transformers
146
 
147
  Laguna is supported in Transformers `v5.7.0` and later ([huggingface/transformers#45673](https://github.com/huggingface/transformers/pull/45673)).