Instructions to use IamCreateAI/Ruyi-Mini-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use IamCreateAI/Ruyi-Mini-7B with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("IamCreateAI/Ruyi-Mini-7B", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -78,17 +78,19 @@ For 24GB VRAM cards such as RTX4090, we provide `low_gpu_memory_mode`, under whi
|
|
| 78 |
|
| 79 |
### Camera Control
|
| 80 |
|
| 81 |
-
<table border="0" style="width: 100%; text-align:
|
| 82 |
<tr>
|
| 83 |
-
<td align=center><img src="https://github.com/user-attachments/assets/8aedcea6-3b8e-4c8b-9fed-9ceca4d41954" width="100%" style="max-height:240px; min-height: 100px"></img>
|
| 84 |
-
<td align=center><video src="https://github.com/user-attachments/assets/d9d027d4-0d4f-45f5-9d46-49860b562c69" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video>
|
| 85 |
-
<td align=center><video src="https://github.com/user-attachments/assets/7716a67b-1bb8-4d44-b128-346cbc35e4ee" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video>
|
| 86 |
</tr>
|
|
|
|
| 87 |
<tr>
|
| 88 |
-
<td align=center><video src="https://github.com/user-attachments/assets/cc1f1928-cab7-4c4b-90af-928936102e66" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video>
|
| 89 |
-
<td align=center><video src="https://github.com/user-attachments/assets/c742ea2c-503a-454f-a61a-10b539100cd9" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video>
|
| 90 |
-
<td align=center><video src="https://github.com/user-attachments/assets/442839fa-cc53-4b75-b015-909e44c065e0" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video>
|
| 91 |
</tr>
|
|
|
|
| 92 |
</table>
|
| 93 |
|
| 94 |
### Motion Amplitude Control
|
|
|
|
| 78 |
|
| 79 |
### Camera Control
|
| 80 |
|
| 81 |
+
<table border="0" style="width: 100%; text-align: center; ">
|
| 82 |
<tr>
|
| 83 |
+
<td align=center><img src="https://github.com/user-attachments/assets/8aedcea6-3b8e-4c8b-9fed-9ceca4d41954" width="100%" style="max-height:240px; min-height: 100px; margin-top: 20%;"></img></td>
|
| 84 |
+
<td align=center><video src="https://github.com/user-attachments/assets/d9d027d4-0d4f-45f5-9d46-49860b562c69" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video></td>
|
| 85 |
+
<td align=center><video src="https://github.com/user-attachments/assets/7716a67b-1bb8-4d44-b128-346cbc35e4ee" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video></td>
|
| 86 |
</tr>
|
| 87 |
+
<tr><td>input</td><td>left</td><td>right</td></tr>
|
| 88 |
<tr>
|
| 89 |
+
<td align=center><video src="https://github.com/user-attachments/assets/cc1f1928-cab7-4c4b-90af-928936102e66" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video></td>
|
| 90 |
+
<td align=center><video src="https://github.com/user-attachments/assets/c742ea2c-503a-454f-a61a-10b539100cd9" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video></td>
|
| 91 |
+
<td align=center><video src="https://github.com/user-attachments/assets/442839fa-cc53-4b75-b015-909e44c065e0" width="100%" style="max-height:360px; min-height: 200px" controls autoplay loop></video></td>
|
| 92 |
</tr>
|
| 93 |
+
<tr><td>static</td><td>up</td><td>down</td></tr>
|
| 94 |
</table>
|
| 95 |
|
| 96 |
### Motion Amplitude Control
|