Add model card: attribution, licences, training config
Browse files
README.md
CHANGED
|
@@ -1,3 +1,91 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: cc-by-4.0
|
| 3 |
+
base_model: Wan-AI/Wan2.1-T2V-1.3B
|
| 4 |
+
pipeline_tag: text-to-video
|
| 5 |
+
tags:
|
| 6 |
+
- world-model
|
| 7 |
+
- video-generation
|
| 8 |
+
- action-conditioned
|
| 9 |
+
- memory
|
| 10 |
+
- ablation
|
| 11 |
+
- research-artifact
|
| 12 |
---
|
| 13 |
+
|
| 14 |
+
# echo — Echo-Memory ablation arm (`ucpe` + two-chunk memory)
|
| 15 |
+
|
| 16 |
+
> **This is an unofficial derivative artifact, not the official Echo-Memory release.**
|
| 17 |
+
> It contains one ablation arm re-trained from the Echo-Memory codebase, produced for
|
| 18 |
+
> internal study. For the official code, paper and checkpoints, use the links below.
|
| 19 |
+
|
| 20 |
+
## Upstream / attribution
|
| 21 |
+
|
| 22 |
+
| | |
|
| 23 |
+
|---|---|
|
| 24 |
+
| Original work | **Echo-Memory: A Controlled Study of Memory in Action World Models** |
|
| 25 |
+
| Authors | Echo Team @ Joy Future Academy, JD |
|
| 26 |
+
| Paper | [arXiv:2606.09803](https://arxiv.org/abs/2606.09803) |
|
| 27 |
+
| Official code | https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory |
|
| 28 |
+
| Official checkpoints | https://huggingface.co/Echo-Team/Echo-Memory |
|
| 29 |
+
| Code license | CC BY 4.0 |
|
| 30 |
+
| Base model | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) (Apache 2.0) |
|
| 31 |
+
|
| 32 |
+
The Echo-Memory code included here is redistributed under CC BY 4.0 with attribution to
|
| 33 |
+
the Echo Team. The weights are derived from Wan2.1-T2V-1.3B, which is Apache 2.0; that
|
| 34 |
+
license and its notices continue to apply to the derived weights.
|
| 35 |
+
|
| 36 |
+
## What this repository contains
|
| 37 |
+
|
| 38 |
+
```
|
| 39 |
+
code/ Echo-Memory codebase as used for this run
|
| 40 |
+
checkpoints/
|
| 41 |
+
Step-10000.safetensors 3.5 GB
|
| 42 |
+
Step-20000.safetensors 3.5 GB
|
| 43 |
+
Step-30000.safetensors 3.5 GB (final, max_train_steps = 30000)
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
## Training configuration
|
| 47 |
+
|
| 48 |
+
Single arm of a memory-mechanism ablation, run name
|
| 49 |
+
`memory_baselines_basic_abl_ucpe_memory_two_chunk`.
|
| 50 |
+
|
| 51 |
+
- Base weights: `Wan2.1-T2V-1.3B` (DiT + `umt5-xxl` text encoder + `Wan2.1_VAE`)
|
| 52 |
+
- Trainable: `dit` only, `--remove_prefix_in_ckpt pipe.dit.`
|
| 53 |
+
- Memory: `--enable_context_memory --context_source replay`
|
| 54 |
+
`--prev_chunk_frames 81 --context_memory_frames 5`
|
| 55 |
+
- Mechanism under test: `--use_cgla_memory --cgla_mechanism ucpe`
|
| 56 |
+
`--cgla_every_n_blocks 4 --cgla_aux_loss_weight 0.01`
|
| 57 |
+
- Also enabled: `--use_moc --moc_temperature 1.0`, `--train_cam_pose`,
|
| 58 |
+
`--add_action_attn`, `--use_rt_relative`, `--use_anchor_frame`, `--cfg_target_only`
|
| 59 |
+
- Resolution / length: 352 x 640, 81 frames
|
| 60 |
+
- Optimisation: lr 2e-5, 1 epoch, batch 1/device, grad-accum 1,
|
| 61 |
+
`--timestep_shift 15`, `--context_drop_prob 0.1`, 30,000 steps
|
| 62 |
+
- Hardware: 1x NVIDIA H20
|
| 63 |
+
|
| 64 |
+
## Data — not redistributed here
|
| 65 |
+
|
| 66 |
+
Training used the **Context-as-Memory** dataset (Unreal-Engine rendered environments,
|
| 67 |
+
~331 GB of frames). It is **not** included in this repository: it is third-party data
|
| 68 |
+
and the copy used here carried no redistribution licence. Obtain it from its original
|
| 69 |
+
source.
|
| 70 |
+
|
| 71 |
+
## Status and caveats
|
| 72 |
+
|
| 73 |
+
- This is **one arm of an ablation sweep**, uploaded as a research artifact.
|
| 74 |
+
Its results had not been analysed at the time of upload — no quality claim is made,
|
| 75 |
+
and it should not be read as the best or recommended configuration.
|
| 76 |
+
- It is **not** a reproduction of, or a replacement for, the official Echo-Memory
|
| 77 |
+
checkpoints. Comparisons against the paper's numbers are not valid without matching
|
| 78 |
+
the official evaluation protocol.
|
| 79 |
+
|
| 80 |
+
## Citation
|
| 81 |
+
|
| 82 |
+
Please cite the original work:
|
| 83 |
+
|
| 84 |
+
```bibtex
|
| 85 |
+
@article{echomemory2026,
|
| 86 |
+
title = {Echo-Memory: A Controlled Study of Memory in Action World Models},
|
| 87 |
+
author = {Echo Team, Joy Future Academy, JD},
|
| 88 |
+
journal= {arXiv preprint arXiv:2606.09803},
|
| 89 |
+
year = {2026}
|
| 90 |
+
}
|
| 91 |
+
```
|