Add SGLang to model card

#14
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -10,6 +10,8 @@ tags:
10
  - cosmos3
11
  - vllm-omni
12
  - diffusers
 
 
13
  - text-to-image
14
  - image-generation
15
  countDownloads:
@@ -211,6 +213,7 @@ Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated sys
211
  - [PyTorch](https://github.com/nvidia/cosmos3)
212
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
213
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
 
214
 
215
  **Supported Hardware Microarchitecture Compatibility:**
216
 
@@ -485,6 +488,12 @@ result.video[0].save("/tmp/cosmos3_t2i.png")
485
  print("Saved image to /tmp/cosmos3_t2i.png")
486
  ```
487
 
 
 
 
 
 
 
488
  ## Limitations
489
 
490
  Cosmos3 may produce imperfect outputs in challenging scenarios. Generation artifacts include temporal inconsistency, unstable camera or object motion, imprecise physical interactions, inaccurate audio-video synchronization, and action-state drift — especially in long-horizon or high-resolution outputs. Reasoning may also be incorrect: object states, causal relationships, spatial geometry, temporal ordering, agent intent, and future outcomes can be misinferred, and complex or long-context inputs may yield hallucinated entities, inconsistent interpretations, or implausible predictions. Because the model lacks an explicit physics simulator, 3D geometry, 4D space-time evolution, object permanence, contact dynamics, and physical laws are only approximated — producing artifacts such as disappearing or morphing objects, unrealistic collisions, and physically implausible motions. Quality further degrades in out-of-distribution environments, safety-critical edge cases, and domains underrepresented in training.
@@ -493,7 +502,7 @@ Cosmos3 outputs should not be treated as physically accurate simulation, reliabl
493
 
494
  ## Inference
495
 
496
- **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers)
497
 
498
  **Test Hardware:** GB200 and H100
499
 
 
10
  - cosmos3
11
  - vllm-omni
12
  - diffusers
13
+ - sglang
14
+ - sglang-diffusion
15
  - text-to-image
16
  - image-generation
17
  countDownloads:
 
213
  - [PyTorch](https://github.com/nvidia/cosmos3)
214
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
215
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
216
+ - [SGLang](https://sgl-project.github.io/)
217
 
218
  **Supported Hardware Microarchitecture Compatibility:**
219
 
 
488
  print("Saved image to /tmp/cosmos3_t2i.png")
489
  ```
490
 
491
+ ### SGLang
492
+
493
+ [SGLang Diffusion](https://sgl-project.github.io/diffusion) can serve `nvidia/Cosmos3-Super-Text2Image` through OpenAI-compatible image generation endpoints.
494
+
495
+ For complete serving instructions and request examples, see the [Cosmos3 SGLang cookbook](https://lmsysorg.mintlify.app/cookbook/diffusion/Cosmos/Cosmos3).
496
+
497
  ## Limitations
498
 
499
  Cosmos3 may produce imperfect outputs in challenging scenarios. Generation artifacts include temporal inconsistency, unstable camera or object motion, imprecise physical interactions, inaccurate audio-video synchronization, and action-state drift — especially in long-horizon or high-resolution outputs. Reasoning may also be incorrect: object states, causal relationships, spatial geometry, temporal ordering, agent intent, and future outcomes can be misinferred, and complex or long-context inputs may yield hallucinated entities, inconsistent interpretations, or implausible predictions. Because the model lacks an explicit physics simulator, 3D geometry, 4D space-time evolution, object permanence, contact dynamics, and physical laws are only approximated — producing artifacts such as disappearing or morphing objects, unrealistic collisions, and physically implausible motions. Quality further degrades in out-of-distribution environments, safety-critical edge cases, and domains underrepresented in training.
 
502
 
503
  ## Inference
504
 
505
+ **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers), [SGLang](https://sgl-project.github.io/), [SGLang Diffusion](https://sgl-project.github.io/diffusion)
506
 
507
  **Test Hardware:** GB200 and H100
508