kediwu0331 commited on
Commit
bc962f1
·
1 Parent(s): 81166f2

add sglang to more sections

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -169,6 +169,7 @@ Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated sys
169
  - [PyTorch](https://github.com/nvidia/cosmos3)
170
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
171
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
 
172
 
173
  **Supported Hardware Microarchitecture Compatibility:**
174
 
@@ -986,6 +987,10 @@ curl -sS -L "http://localhost:30000/v1/videos/${job_id}/content" \
986
 
987
  Video-to-video, video-with-sound, and action generation are not supported by SGLang yet.
988
 
 
 
 
 
989
  ## Limitations
990
 
991
  Cosmos3 may produce imperfect outputs in challenging scenarios. Generation artifacts include temporal inconsistency, unstable camera or object motion, imprecise physical interactions, inaccurate audio-video synchronization, and action-state drift — especially in long-horizon or high-resolution outputs. Reasoning may also be incorrect: object states, causal relationships, spatial geometry, temporal ordering, agent intent, and future outcomes can be misinferred, and complex or long-context inputs may yield hallucinated entities, inconsistent interpretations, or implausible predictions. Because the model lacks an explicit physics simulator, 3D geometry, 4D space-time evolution, object permanence, contact dynamics, and physical laws are only approximated — producing artifacts such as disappearing or morphing objects, unrealistic collisions, and physically implausible motions. Quality further degrades in out-of-distribution environments, safety-critical edge cases, and domains underrepresented in training.
@@ -994,7 +999,7 @@ Cosmos3 outputs should not be treated as physically accurate simulation, reliabl
994
 
995
  ## Inference
996
 
997
- **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers)
998
 
999
  **Test Hardware:** GB200 and H100
1000
 
 
169
  - [PyTorch](https://github.com/nvidia/cosmos3)
170
  - [vLLM-Omni](https://github.com/vllm-project/vllm-omni)
171
  - [Hugging Face Diffusers](https://huggingface.co/docs/diffusers/en/index)
172
+ - [SGLang](https://sgl-project.github.io/)
173
 
174
  **Supported Hardware Microarchitecture Compatibility:**
175
 
 
987
 
988
  Video-to-video, video-with-sound, and action generation are not supported by SGLang yet.
989
 
990
+ [SGLang Diffusion](https://sgl-project.github.io/diffusion) can serve `nvidia/Cosmos3-Super` through OpenAI-compatible image and video generation endpoints.
991
+
992
+ For complete serving instructions and request examples, see the [Cosmos3 SGLang cookbook](https://lmsysorg.mintlify.app/cookbook/diffusion/Cosmos/Cosmos3).
993
+
994
  ## Limitations
995
 
996
  Cosmos3 may produce imperfect outputs in challenging scenarios. Generation artifacts include temporal inconsistency, unstable camera or object motion, imprecise physical interactions, inaccurate audio-video synchronization, and action-state drift — especially in long-horizon or high-resolution outputs. Reasoning may also be incorrect: object states, causal relationships, spatial geometry, temporal ordering, agent intent, and future outcomes can be misinferred, and complex or long-context inputs may yield hallucinated entities, inconsistent interpretations, or implausible predictions. Because the model lacks an explicit physics simulator, 3D geometry, 4D space-time evolution, object permanence, contact dynamics, and physical laws are only approximated — producing artifacts such as disappearing or morphing objects, unrealistic collisions, and physically implausible motions. Quality further degrades in out-of-distribution environments, safety-critical edge cases, and domains underrepresented in training.
 
999
 
1000
  ## Inference
1001
 
1002
+ **Acceleration Engine:** [PyTorch](https://pytorch.org/), [vLLM](https://github.com/vllm-project/vllm), [vLLM-Omni](https://github.com/vllm-project/vllm-omni), [Hugging Face Diffusers](https://github.com/huggingface/diffusers), [SGLang](https://sgl-project.github.io/), [SGLang Diffusion](https://sgl-project.github.io/diffusion)
1003
 
1004
  **Test Hardware:** GB200 and H100
1005