docs: note SGLang support
Browse files
README.md
CHANGED
|
@@ -7,6 +7,7 @@ extra_gated_description: >-
|
|
| 7 |
tags:
|
| 8 |
- laguna-m.1
|
| 9 |
- vllm
|
|
|
|
| 10 |
- bf16
|
| 11 |
- moe
|
| 12 |
license: apache-2.0
|
|
@@ -86,7 +87,7 @@ Laguna M.1 is a 225B total parameter Mixture-of-Experts model with 23B activated
|
|
| 86 |
|
| 87 |
## Usage
|
| 88 |
|
| 89 |
-
Laguna M.1 has upstream support in vLLM and Transformers, and TRT-LLM thanks to the support of the team at NVIDIA.
|
| 90 |
|
| 91 |
### pool
|
| 92 |
|
|
@@ -137,6 +138,10 @@ vllm serve \
|
|
| 137 |
|
| 138 |
See the [vLLM recipes page](https://recipes.vllm.ai/poolside/Laguna-XS.2) for our Laguna XS.2 model with which the implementation is shared for additional deployment guidance. FP8 and NVFP4 quantized checkpoints are available at [Laguna-M.1-FP8](https://huggingface.co/poolside/Laguna-M.1-FP8) and [Laguna-M.1-NVFP4](https://huggingface.co/poolside/Laguna-M.1-NVFP4); quantization is detected automatically from `quantization_config`, so the same command works with the model ID substituted.
|
| 139 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 140 |
#### Transformers
|
| 141 |
|
| 142 |
Laguna is supported in Transformers `v5.7.0` and later ([huggingface/transformers#45673](https://github.com/huggingface/transformers/pull/45673)).
|
|
|
|
| 7 |
tags:
|
| 8 |
- laguna-m.1
|
| 9 |
- vllm
|
| 10 |
+
- sglang
|
| 11 |
- bf16
|
| 12 |
- moe
|
| 13 |
license: apache-2.0
|
|
|
|
| 87 |
|
| 88 |
## Usage
|
| 89 |
|
| 90 |
+
Laguna M.1 has upstream support in vLLM, SGLang, and Transformers, and TRT-LLM thanks to the support of the team at NVIDIA.
|
| 91 |
|
| 92 |
### pool
|
| 93 |
|
|
|
|
| 138 |
|
| 139 |
See the [vLLM recipes page](https://recipes.vllm.ai/poolside/Laguna-XS.2) for our Laguna XS.2 model with which the implementation is shared for additional deployment guidance. FP8 and NVFP4 quantized checkpoints are available at [Laguna-M.1-FP8](https://huggingface.co/poolside/Laguna-M.1-FP8) and [Laguna-M.1-NVFP4](https://huggingface.co/poolside/Laguna-M.1-NVFP4); quantization is detected automatically from `quantization_config`, so the same command works with the model ID substituted.
|
| 140 |
|
| 141 |
+
#### SGLang
|
| 142 |
+
|
| 143 |
+
Laguna M.1 is supported in SGLang via [sgl-project/sglang#28400](https://github.com/sgl-project/sglang/pull/28400). A full serving recipe will be added here; for now, build SGLang from a `main` that includes that PR.
|
| 144 |
+
|
| 145 |
#### Transformers
|
| 146 |
|
| 147 |
Laguna is supported in Transformers `v5.7.0` and later ([huggingface/transformers#45673](https://github.com/huggingface/transformers/pull/45673)).
|