Image-Text-to-Video
Diffusers
Safetensors
orbitquant
comfyui
w4
w4a4
native-w4a4-transformer-runtime
text-to-video
audio-video-generation
8-bit precision
Instructions to use WaveCut/MiniMax-H3-OrbitQuant-W4A4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use WaveCut/MiniMax-H3-OrbitQuant-W4A4 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("WaveCut/MiniMax-H3-OrbitQuant-W4A4", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
| { | |
| "schema_version": 2, | |
| "source_model_id": "MiniMaxAI/MiniMax-H3", | |
| "source_revision": "73372e6cf53e414edd3ab03e357717fb0602e758", | |
| "settings": { | |
| "height": 480, | |
| "width": 608, | |
| "num_frames": 124, | |
| "fps": 24, | |
| "num_inference_steps": 50, | |
| "model_evaluations": 49 | |
| }, | |
| "prompts": [ | |
| { | |
| "id": "dynamic-zoom-rain-ru", | |
| "title": "Fast motion, face integrity, zoom, and Russian dialogue", | |
| "task": "t2va", | |
| "seed": 74001, | |
| "prompt": "Single continuous live-action shot, no cuts. In heavy rain at night, a woman in a yellow raincoat runs directly toward the camera. The camera rapidly dollies backward, then smoothly zooms from a medium close-up to an extreme close-up of her face in the first two seconds. She turns her head left and right while running; wet hair crosses her cheeks; she looks into the lens and says in Russian: «Не отставай, мы почти пришли». Preserve the same face, natural eyes and lips, persistent skin texture, realistic motion blur, neon reflections, rain ambience." | |
| }, | |
| { | |
| "id": "astronaut-reference", | |
| "title": "Reference identity and controlled hand motion", | |
| "task": "ref2va", | |
| "seed": 74002, | |
| "reference": "examples/reference/astronaut.png", | |
| "reference_source": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/astronaut.jpg", | |
| "prompt": "Use <Picture 1> as the exact subject reference. In a single continuous shot, the astronaut slowly raises one gloved hand and waves once while the camera smoothly pushes from a medium shot to a close-up. Preserve the helmet, suit markings, face identity, natural eyes, and lunar lighting across all motion. Quiet radio static and one short electronic confirmation beep." | |
| } | |
| ] | |
| } | |