Instructions to use Skywork/Matrix-Game-2.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Skywork/Matrix-Game-2.0 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Skywork/Matrix-Game-2.0", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,7 @@ base_model:
|
|
| 29 |
|
| 30 |
- 🚀 **Feature 1**: **Real-Time Distillation** Efficient few-step diffusion for streaming video synthesis at 25 FPS, producing minute-level, high-fidelity videos across complex environments with ultra-fast speed.
|
| 31 |
- 🖱️ **Feature 2**: **Precise Action Injection** A mouse/keyboard-to-frame module that embeds user inputs as direct interactions, enabling frame-level control and dynamic response in generated videos.
|
| 32 |
-
- 🎬 **Feature 3**: **Massive Interactive Data Pipeline** A scalable production system for Unreal Engine & GTA5 that generates ~
|
| 33 |
|
| 34 |
## 🔥 Latest Updates
|
| 35 |
|
|
|
|
| 29 |
|
| 30 |
- 🚀 **Feature 1**: **Real-Time Distillation** Efficient few-step diffusion for streaming video synthesis at 25 FPS, producing minute-level, high-fidelity videos across complex environments with ultra-fast speed.
|
| 31 |
- 🖱️ **Feature 2**: **Precise Action Injection** A mouse/keyboard-to-frame module that embeds user inputs as direct interactions, enabling frame-level control and dynamic response in generated videos.
|
| 32 |
+
- 🎬 **Feature 3**: **Massive Interactive Data Pipeline** A scalable production system for Unreal Engine & GTA5 that generates ~1200 hours of high-quality interactive video data, covering diverse scenes with frame-level realism.
|
| 33 |
|
| 34 |
## 🔥 Latest Updates
|
| 35 |
|