Instructions to use wfen/Cosmos3-Nano-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use wfen/Cosmos3-Nano-NVFP4 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("wfen/Cosmos3-Nano-NVFP4", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 594 Bytes
b30771b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 | {
"recipe": "nvfp4_awq",
"weight_only": true,
"quant_lmhead": true,
"modelopt_artifact": "transformer/modelopt_quantized.pt",
"loader": "Cosmos3OmniTransformer.from_config + modelopt.restore_from_modelopt_state + safetensors load_state_dict",
"exclusions": [
"embed_tokens",
"*norm*",
"time_embedder",
"proj_in",
"proj_out",
"audio_*",
"action_*"
],
"scale_layout": {
"weight_scale_suffixes": [
"_amax",
"_scale"
],
"global_scale_suffixes": [],
"n_weight": 802,
"n_scale": 1010,
"granularity": "per-block-16"
}
} |