sprited commited on
Commit
e322fd0
·
verified ·
1 Parent(s): e6be337

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - video-diffusion
5
+ - diffusion
6
+ - pytorch
7
+ - sprited
8
+ datasets:
9
+ - sprited/dancing-chibi-figures
10
+ ---
11
+
12
+ # Dancing Chibi Figures — baseline checkpoints
13
+
14
+ Reference checkpoints for the [sprited/dancing-chibi-figures](https://huggingface.co/datasets/sprited/dancing-chibi-figures)
15
+ dataset, trained with the pure-PyTorch trainer in the [dataset's GitHub repo](https://github.com/sprited-ai/dancing-chibi-figures)
16
+ (`train/video_ddpm.py` — factorised 3D UNet, v-prediction, cosine schedule, EMA).
17
+
18
+ | file | what | steps |
19
+ |---|---|---|
20
+ | `unet_img64.pt` | unconditional 64px image model (`--frames 1`) | 30k |
21
+ | `unet_t2v64.pt` | text-conditioned autoregressive video model (`--cond text --ar_ctx 8 --frames 8 --stride 2`, CLIP prompt embeddings) | 60k |
22
+
23
+ Used by the [Colab tutorial](https://github.com/sprited-ai/dancing-chibi-figures/blob/main/notebooks/dancing_chibi_figures_colab.ipynb)
24
+ as the warm-start image model and the "fully-trained" reference. Generate a prompt-controlled dance:
25
+
26
+ ```bash
27
+ python scripts/rollout.py --ckpt unet_t2v64.pt --prompt "A person jumps in place." --seconds 5 --n 8 --out dance.gif
28
+ ```
29
+
30
+ Prefer standard 🤗 diffusers? See [sprited/dancing-chibi-figures-ddpm-64](https://huggingface.co/sprited/dancing-chibi-figures-ddpm-64)
31
+ (unconditional `DDPMPipeline`) and [sprited/dancing-chibi-figures-t2i-64](https://huggingface.co/sprited/dancing-chibi-figures-t2i-64)
32
+ (text-to-image, mini-Stable-Diffusion style). Made by [Sprited](https://sprited.ai).