Upload toy example checkpoint and data
Browse files- README.md +59 -0
- diffusion_420000.ckpt +3 -0
- toy.npy +3 -0
README.md
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: pytorch
|
| 3 |
+
tags:
|
| 4 |
+
- diffusion
|
| 5 |
+
- planning
|
| 6 |
+
- compositional-generation
|
| 7 |
+
- toy-example
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# Compositional Visual Planning: toy example
|
| 11 |
+
|
| 12 |
+
Pretrained weights and training data of the toy example (Figure 2) in
|
| 13 |
+
[Compositional Visual Planning via Inference-Time Diffusion Scaling](https://arxiv.org/abs/2603.02646)
|
| 14 |
+
([project page](https://comp-visual-planning.github.io/)). A short-horizon diffusion model is trained on
|
| 15 |
+
circular arc clips; at test time three 120° arc generators are composed into a three-petal "flower" by
|
| 16 |
+
enforcing boundary agreement between the chunks at every denoising step.
|
| 17 |
+
|
| 18 |
+
## Files
|
| 19 |
+
|
| 20 |
+
| File | Description | Size |
|
| 21 |
+
| --- | --- | --- |
|
| 22 |
+
| `diffusion_420000.ckpt` | `{"model": ..., "model_ema": ...}` state dicts of the DiT1d denoiser (in_dim 60, emb_dim 256, d_model 384, 12 heads, 6 blocks; x0 prediction, 500 cosine diffusion steps) after 420k gradient steps on 8-token clips | 132 MB |
|
| 23 |
+
| `toy.npy` | training data, float64 array of shape (64, 600, 2): 64 rotated flowers, each a closed curve of 600 (x, y) points made of three noisy 120° arcs | 0.6 MB |
|
| 24 |
+
|
| 25 |
+
## Usage
|
| 26 |
+
|
| 27 |
+
The toy example code downloads both files automatically when they are missing locally. To fetch them by hand:
|
| 28 |
+
|
| 29 |
+
```bash
|
| 30 |
+
pip install -U huggingface_hub
|
| 31 |
+
hf download comp-visual-planning/toy-example diffusion_420000.ckpt --local-dir ckpts
|
| 32 |
+
hf download comp-visual-planning/toy-example toy.npy --local-dir data
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
or from python:
|
| 36 |
+
|
| 37 |
+
```python
|
| 38 |
+
from huggingface_hub import hf_hub_download
|
| 39 |
+
|
| 40 |
+
ckpt = hf_hub_download("comp-visual-planning/toy-example", "diffusion_420000.ckpt", local_dir="ckpts")
|
| 41 |
+
data = hf_hub_download("comp-visual-planning/toy-example", "toy.npy", local_dir="data")
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
Then, from the root of the toy example repository, run `python eval.py method=cvp` (ours) or
|
| 45 |
+
`python eval.py method=gsc` (DiffCollage / Generative Skill Chaining baseline).
|
| 46 |
+
|
| 47 |
+
## Citation
|
| 48 |
+
|
| 49 |
+
```bibtex
|
| 50 |
+
@misc{zhang2026compositionalvisualplanninginferencetime,
|
| 51 |
+
title={Compositional Visual Planning via Inference-Time Diffusion Scaling},
|
| 52 |
+
author={Yixin Zhang and Yunhao Luo and Utkarsh Aashu Mishra and Woo Chul Shin and Yongxin Chen and Danfei Xu},
|
| 53 |
+
year={2026},
|
| 54 |
+
eprint={2603.02646},
|
| 55 |
+
archivePrefix={arXiv},
|
| 56 |
+
primaryClass={cs.RO},
|
| 57 |
+
url={https://arxiv.org/abs/2603.02646},
|
| 58 |
+
}
|
| 59 |
+
```
|
diffusion_420000.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:400e0b64af354076830194bcc8ce2b150442ffac8f12c6ae8d0d65a1bf719c48
|
| 3 |
+
size 132444906
|
toy.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a106d34e75a9d6163852d5131c2b6067da7757296ca5b97f53fee1b040e6006c
|
| 3 |
+
size 614528
|