Cosmos
Diffusers
Safetensors
cosmos3_omni
nvidia
cosmos3
vllm
vllm-omni
text, image, video, audio, and action generation
omnimodel
Instructions to use Runware/Cosmos3-Nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Cosmos
How to use Runware/Cosmos3-Nano with Cosmos:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Diffusers
How to use Runware/Cosmos3-Nano with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Runware/Cosmos3-Nano", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Add files using upload-large-folder tool
Browse files- assets/example_action_fd_agibotworld_4chunk_output.mp4 +3 -0
- assets/example_action_id_av_0_output.png +3 -0
- assets/example_i2vs_output.mp4 +3 -0
- assets/example_reasoning_input.png +3 -0
- assets/example_t2vs_output.mp4 +3 -0
- images/benchmark-overall.png +3 -0
- images/benchmark-reasoning.png +3 -0
- sound_tokenizer/diffusion_pytorch_model.safetensors +3 -0
- transformer/diffusion_pytorch_model-00001-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00002-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00003-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00004-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00005-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00006-of-00007.safetensors +3 -0
- transformer/diffusion_pytorch_model-00007-of-00007.safetensors +3 -0
- vae/diffusion_pytorch_model.safetensors +3 -0
- vision_encoder/model.safetensors +3 -0
assets/example_action_fd_agibotworld_4chunk_output.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9b01266b6cd27478514133b00ada9c33db3f9444167f09942c11f880c629c8c0
|
| 3 |
+
size 672918
|
assets/example_action_id_av_0_output.png
ADDED
|
Git LFS Details
|
assets/example_i2vs_output.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5ef623a93fe7ef813e3ca3a3037428a0f93a7146595d848ce497cd40d7fa1a2e
|
| 3 |
+
size 17843192
|
assets/example_reasoning_input.png
ADDED
|
Git LFS Details
|
assets/example_t2vs_output.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3cc8ac15acd0a448a1fcbd072fad9d465c0dace760efd8e2be1e9a7b9f89af0c
|
| 3 |
+
size 4053521
|
images/benchmark-overall.png
ADDED
|
Git LFS Details
|
images/benchmark-reasoning.png
ADDED
|
Git LFS Details
|
sound_tokenizer/diffusion_pytorch_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d4c61cde38acfb0cad9048a140c3533750277a8462b19dc08450d9fe1ad9879
|
| 3 |
+
size 1892409600
|
transformer/diffusion_pytorch_model-00001-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d0f718198cac14cf323d58568c78aa1290b4bd1dcced6481624b5b9c6d70dc2
|
| 3 |
+
size 4902257280
|
transformer/diffusion_pytorch_model-00002-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e6e7d270c193a58a1aec0cbc89f6f5afcaef6e3b951d86b0a432244c449e34e
|
| 3 |
+
size 4999863656
|
transformer/diffusion_pytorch_model-00003-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:15d08936149a7e77c6668e5b1cd47dc92a35e33741f0090d619045b66da9ff8d
|
| 3 |
+
size 4932719448
|
transformer/diffusion_pytorch_model-00004-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02cebbb557bced701eb825901e1de5f86d2e1feb49cb9a8d1fb7d1b878fdb31b
|
| 3 |
+
size 4983084656
|
transformer/diffusion_pytorch_model-00005-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a5e3edd742b8f1fcf27a3eb3878c67dfcb0e6881588fa35deef503d640ea69d1
|
| 3 |
+
size 4949498576
|
transformer/diffusion_pytorch_model-00006-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1bb99750f7ab4a47f8b0403a87aa43fefc9648660609ab2ace4cab361b957cd0
|
| 3 |
+
size 4261644464
|
transformer/diffusion_pytorch_model-00007-of-00007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f159bc8b82477adde771ae9e4f54f76564e02844a2fc6267903bd745111d7f6
|
| 3 |
+
size 1318361208
|
vae/diffusion_pytorch_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:230496cb59ff85bc9c040487737c4062480cb61c71e697b197b4c30142f2a0da
|
| 3 |
+
size 1409400600
|
vision_encoder/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0c0f719fcf5f2cdadb676701477c236020713657976592ad046583707a6a95a
|
| 3 |
+
size 1152811416
|