Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- video-diffusion
|
| 5 |
+
- diffusion
|
| 6 |
+
- pytorch
|
| 7 |
+
- sprited
|
| 8 |
+
datasets:
|
| 9 |
+
- sprited/dancing-chibi-figures
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# Dancing Chibi Figures — baseline checkpoints
|
| 13 |
+
|
| 14 |
+
Reference checkpoints for the [sprited/dancing-chibi-figures](https://huggingface.co/datasets/sprited/dancing-chibi-figures)
|
| 15 |
+
dataset, trained with the pure-PyTorch trainer in the [dataset's GitHub repo](https://github.com/sprited-ai/dancing-chibi-figures)
|
| 16 |
+
(`train/video_ddpm.py` — factorised 3D UNet, v-prediction, cosine schedule, EMA).
|
| 17 |
+
|
| 18 |
+
| file | what | steps |
|
| 19 |
+
|---|---|---|
|
| 20 |
+
| `unet_img64.pt` | unconditional 64px image model (`--frames 1`) | 30k |
|
| 21 |
+
| `unet_t2v64.pt` | text-conditioned autoregressive video model (`--cond text --ar_ctx 8 --frames 8 --stride 2`, CLIP prompt embeddings) | 60k |
|
| 22 |
+
|
| 23 |
+
Used by the [Colab tutorial](https://github.com/sprited-ai/dancing-chibi-figures/blob/main/notebooks/dancing_chibi_figures_colab.ipynb)
|
| 24 |
+
as the warm-start image model and the "fully-trained" reference. Generate a prompt-controlled dance:
|
| 25 |
+
|
| 26 |
+
```bash
|
| 27 |
+
python scripts/rollout.py --ckpt unet_t2v64.pt --prompt "A person jumps in place." --seconds 5 --n 8 --out dance.gif
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
Prefer standard 🤗 diffusers? See [sprited/dancing-chibi-figures-ddpm-64](https://huggingface.co/sprited/dancing-chibi-figures-ddpm-64)
|
| 31 |
+
(unconditional `DDPMPipeline`) and [sprited/dancing-chibi-figures-t2i-64](https://huggingface.co/sprited/dancing-chibi-figures-t2i-64)
|
| 32 |
+
(text-to-image, mini-Stable-Diffusion style). Made by [Sprited](https://sprited.ai).
|