Cosmos
Diffusers
Safetensors
cosmos3_omni
nvidia
cosmos3
vllm
vllm-omni
text, image, video, audio, and action generation
omnimodel
Instructions to use nvidia/Cosmos3-Nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Cosmos
How to use nvidia/Cosmos3-Nano with Cosmos:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Diffusers
How to use nvidia/Cosmos3-Nano with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("nvidia/Cosmos3-Nano", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 7,710 Bytes
138d071 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 | {
"subjects": [
{
"description": "A modern industrial robotic arm with a silver and dark gray metallic body, featuring multiple articulated joints and a flat rubber-padded gripper end-effector holding a green sponge. The arm has visible hydraulic cables and a smooth polished finish.",
"appearance_details": "The robotic arm has a sturdy base bolted to the countertop, with branded serial number markings on the shoulder joint. The gripper holds a standard green and yellow kitchen sponge. Small LED indicator lights glow blue near the base.",
"relationship": "Primary subject interacting with the dirty plate",
"location": "Center-right of frame",
"relative_size": "Large within frame",
"orientation": "Angled toward camera at roughly 45 degrees, arm extending downward toward the plate",
"pose": "Extended downward with the end-effector pressing the sponge against the plate surface",
"action": "Wiping a dirty plate with circular and sweeping motions",
"state_changes": "The arm moves fluidly from one side of the plate to the other, rotating its wrist joint to apply even pressure across the plate surface",
"clothing": "",
"expression": "",
"gender": "",
"age": "",
"skin_tone_and_texture": "",
"facial_features": "",
"number_of_subjects": 1,
"number_of_arms": 0,
"number_of_legs": 0
},
{
"description": "A white ceramic dinner plate with dried food residue, sauce stains, and grease marks covering its surface. Standard 10-inch round plate with a slightly raised rim.",
"appearance_details": "The plate has brownish-orange dried sauce, bits of dried food particles, and oily smears. As the sponge wipes across, clean white ceramic is revealed underneath.",
"relationship": "Object being cleaned by the robotic arm",
"location": "Center-left foreground, resting on the countertop",
"relative_size": "Medium within frame",
"orientation": "Flat, face-up on the counter",
"pose": "Stationary on the kitchen countertop",
"action": "Being wiped clean",
"state_changes": "Progressively becomes cleaner as the robotic arm wipes away the food residue, transitioning from dirty to mostly clean",
"clothing": "",
"expression": "",
"gender": "",
"age": "",
"skin_tone_and_texture": "",
"facial_features": "",
"number_of_subjects": 1,
"number_of_arms": 0,
"number_of_legs": 0
}
],
"background_setting": "A modern, well-organized residential kitchen with light gray granite countertops, white cabinetry with brushed nickel handles, a stainless steel sink visible to the left, and a tiled backsplash in a subtle herringbone pattern. A dish rack with a few clean plates sits near the sink. A window above the sink lets in natural daylight. Small potted herbs sit on the windowsill.",
"lighting": {
"conditions": "Bright, mixed natural and artificial lighting \u2014 daylight from the window supplemented by warm overhead LED kitchen lights",
"direction": "Primary light from the left (window) with soft overhead fill from above",
"shadows": "Soft shadows cast by the robotic arm onto the countertop and plate, with a gentle shadow beneath the plate",
"illumination_effect": "Clean, well-lit domestic atmosphere with slight warm tones from the overhead lights blending with cooler daylight from the window"
},
"aesthetics": {
"composition": "The robotic arm and plate are centered in the frame with the kitchen environment providing context in the background. The diagonal line of the arm creates dynamic visual interest.",
"color_scheme": "Neutral palette of whites, grays, and silver metallics with pops of green from the sponge and herbs, warm wood tones from a cutting board in the background",
"mood_atmosphere": "Futuristic domestic, clean, efficient, slightly whimsical",
"patterns": "Herringbone tile pattern on the backsplash"
},
"cinematography": {
"camera_motion": "Slow, subtle push-in toward the plate as it gets cleaner",
"framing": "Medium close-up shot capturing the robotic arm, plate, and immediate countertop area",
"camera_angle": "Slightly high angle, approximately 30 degrees above eye level, looking down at the plate",
"depth_of_field": "Shallow",
"focus": "Sharp focus on the sponge-plate contact point and the robotic arm's gripper",
"lens_focal_length": "50mm equivalent"
},
"style_medium": "Live-action video",
"artistic_style": "Realistic, clean tech-demo aesthetic with cinematic color grading",
"context": "Demonstration of a robotic kitchen assistant performing a household chore, suitable for a technology showcase or smart home advertisement",
"actions": [
{
"time": "0:00-0:02",
"description": "The robotic arm lowers the sponge onto the dirty plate and begins its first wiping pass from the center outward"
},
{
"time": "0:02-0:05",
"description": "The arm performs circular wiping motions across the plate surface, rotating its wrist joint, progressively removing dried food and sauce stains"
},
{
"time": "0:05-0:07",
"description": "The arm makes final sweeping passes across the now mostly-clean plate, then lifts the sponge slightly, revealing the cleaned surface"
}
],
"text_and_signage_elements": [],
"segments": [
{
"segment_index": 0,
"time_range": "0:00-0:02",
"description": "The robotic arm descends and makes initial contact with the dirty plate, beginning the wiping process",
"key_changes": "Arm transitions from hovering position to active contact with plate; first streak of clean ceramic appears",
"camera": "Static with very subtle push-in beginning"
},
{
"segment_index": 1,
"time_range": "0:02-0:05",
"description": "Main cleaning action as the robotic arm performs systematic circular wiping motions across the plate",
"key_changes": "Plate progressively becomes cleaner; food residue is visibly displaced by the sponge; water droplets and suds appear",
"camera": "Continuing slow push-in, maintaining focus on the cleaning action"
},
{
"segment_index": 2,
"time_range": "0:05-0:07",
"description": "Final cleaning passes and the arm lifts away to reveal the clean plate",
"key_changes": "Plate transitions from mostly clean to fully clean; arm lifts sponge and retracts slightly upward",
"camera": "Push-in completes; camera holds steady on the clean plate"
}
],
"transitions": [],
"temporal_caption": "The video opens with a robotic arm positioned above a dirty white plate on a kitchen countertop. In the first two seconds, the arm lowers its sponge-equipped gripper onto the plate and begins a sweeping motion from center to edge. From seconds two through five, the arm performs methodical circular wiping motions, its wrist joint rotating smoothly as dried food and sauce stains are progressively removed, revealing clean white ceramic beneath. Small water droplets and light suds form on the plate surface. In the final two seconds, the arm completes its last passes across the now-clean plate and lifts the sponge upward, pausing briefly as if inspecting its work, with the gleaming clean plate fully visible below.",
"resolution": {
"W": 1280,
"H": 720
},
"aspect_ratio": "16,9",
"duration": "7s",
"fps": 24
} |