kediwu0331 commited on
Commit
7a79dc6
·
1 Parent(s): adf3042

add sglang to more sections

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -168,6 +168,7 @@ Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated sys
168
  - [PyTorch](https://github.com/nvidia/cosmos3)
169
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
170
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
 
171
 
172
  **Supported Hardware Microarchitecture Compatibility:**
173
 
@@ -385,7 +386,7 @@ print("Saved image to /tmp/cosmos3_t2i.png")
385
 
386
  ### SGLang
387
 
388
- SGLang-Diffusion can serve `nvidia/Cosmos3-Super-Text2Image` through the OpenAI-compatible image generation endpoint. Install SGLang from the main branch with diffusion dependencies, then start the server:
389
 
390
  ```bash
391
  git clone --branch main https://github.com/sgl-project/sglang.git
@@ -420,6 +421,8 @@ curl -sS -X POST http://localhost:30000/v1/images/generations \
420
  }'
421
  ```
422
 
 
 
423
  ### Diffusers
424
 
425
  Cosmos3 is fully supported within the popular HuggingFace Diffusers package. This integration makes it a supported inference backend, allowing developers to easily incorporate Cosmos3's capabilities - such as text-to-image generation - into their pipelines using the Cosmos3OmniPipeline class, as demonstrated by the provided code examples (see examples for other modalities on the HuggingFace Cosmos3 page).
@@ -487,7 +490,7 @@ Cosmos3 outputs should not be treated as physically accurate simulation, reliabl
487
 
488
  ## Inference
489
 
490
- **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers)
491
 
492
  **Test Hardware:** GB200 and H100
493
 
 
168
  - [PyTorch](https://github.com/nvidia/cosmos3)
169
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
170
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
171
+ - [SGLang](https://sgl-project.github.io/)
172
 
173
  **Supported Hardware Microarchitecture Compatibility:**
174
 
 
386
 
387
  ### SGLang
388
 
389
+ [SGLang Diffusion](https://sgl-project.github.io/diffusion) can serve `nvidia/Cosmos3-Super-Text2Image` through OpenAI-compatible image generation endpoints. Install SGLang from the main branch with diffusion dependencies, then start the server:
390
 
391
  ```bash
392
  git clone --branch main https://github.com/sgl-project/sglang.git
 
421
  }'
422
  ```
423
 
424
+ For complete serving instructions and request examples, see the [Cosmos3 SGLang cookbook](https://lmsysorg.mintlify.app/cookbook/diffusion/Cosmos/Cosmos3).
425
+
426
  ### Diffusers
427
 
428
  Cosmos3 is fully supported within the popular HuggingFace Diffusers package. This integration makes it a supported inference backend, allowing developers to easily incorporate Cosmos3's capabilities - such as text-to-image generation - into their pipelines using the Cosmos3OmniPipeline class, as demonstrated by the provided code examples (see examples for other modalities on the HuggingFace Cosmos3 page).
 
490
 
491
  ## Inference
492
 
493
+ **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers), [SGLang](https://sgl-project.github.io/), [SGLang Diffusion](https://sgl-project.github.io/diffusion)
494
 
495
  **Test Hardware:** GB200 and H100
496