Add image-to-video pipeline tag and link to paper
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,19 +1,22 @@
|
|
| 1 |
---
|
| 2 |
-
license: cc-by-4.0
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
|
|
|
|
|
|
| 5 |
tags:
|
| 6 |
- video-generation
|
| 7 |
- world-model
|
| 8 |
- memory
|
| 9 |
- action-conditioned
|
| 10 |
- wan
|
| 11 |
-
library_name: diffsynth
|
| 12 |
---
|
| 13 |
|
| 14 |
# Echo-Memory — Wan 2.1 1.3B memory baseline checkpoints
|
| 15 |
|
| 16 |
-
Paper-aligned **epoch-0** fine-tunes for [Echo-Memory](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory)
|
|
|
|
|
|
|
| 17 |
|
| 18 |
**Backbone:** [Wan-AI/Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)
|
| 19 |
**Training:** static in-domain pool · 1 epoch · **30,000 steps** · 640×352 · 81-frame chunks
|
|
@@ -72,8 +75,20 @@ PHASE=stage1 OOD_DIR=assets/opendomain_revisit \
|
|
| 72 |
|
| 73 |
Memory runtime flags are inferred from the checkpoint path via `env/memory_baseline_runtime.py` — use the HF folder names above.
|
| 74 |
|
| 75 |
-
Full docs: [doc/checkpoints.md](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory/blob/main/doc/checkpoints.md)
|
| 76 |
-
|
| 77 |
## Citation
|
| 78 |
|
| 79 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
library_name: diffsynth
|
| 5 |
+
license: cc-by-4.0
|
| 6 |
+
pipeline_tag: image-to-video
|
| 7 |
tags:
|
| 8 |
- video-generation
|
| 9 |
- world-model
|
| 10 |
- memory
|
| 11 |
- action-conditioned
|
| 12 |
- wan
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
# Echo-Memory — Wan 2.1 1.3B memory baseline checkpoints
|
| 16 |
|
| 17 |
+
Paper-aligned **epoch-0** fine-tunes for [Echo-Memory](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory).
|
| 18 |
+
|
| 19 |
+
[**Paper**](https://huggingface.co/papers/2606.09803) | [**Project Page**](https://echo-team-joy-future-academy-jd.github.io/Echo-Memory/) | [**GitHub**](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory)
|
| 20 |
|
| 21 |
**Backbone:** [Wan-AI/Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B)
|
| 22 |
**Training:** static in-domain pool · 1 epoch · **30,000 steps** · 640×352 · 81-frame chunks
|
|
|
|
| 75 |
|
| 76 |
Memory runtime flags are inferred from the checkpoint path via `env/memory_baseline_runtime.py` — use the HF folder names above.
|
| 77 |
|
|
|
|
|
|
|
| 78 |
## Citation
|
| 79 |
|
| 80 |
+
If you use this repository or the Echo-Memory paper, please cite:
|
| 81 |
+
|
| 82 |
+
```bibtex
|
| 83 |
+
@article{king2026echomemory,
|
| 84 |
+
title={Echo-Memory: A Controlled Study of Memory in Action World Models},
|
| 85 |
+
author={King, Wayne and Xue, Zeyue and Bian, Yuxuan and Huang, Jie and Li, Haoran and Li, Yaowei and Su, Yaofeng and Li, Yuming and Wang, Haoyu and Zhang, Shiyi and Zhang, Songchun and Niu, Yuwei and Xu, Sihan and Zhuang, Junhao and Huang, Haoyang and Duan, Nan},
|
| 86 |
+
journal={arXiv preprint arXiv:2606.09803},
|
| 87 |
+
year={2026},
|
| 88 |
+
month={jun},
|
| 89 |
+
eprint={2606.09803},
|
| 90 |
+
archivePrefix={arXiv},
|
| 91 |
+
primaryClass={cs.CV},
|
| 92 |
+
url={https://arxiv.org/abs/2606.09803}
|
| 93 |
+
}
|
| 94 |
+
```
|