amonshano commited on
Commit
5c44b7e
·
verified ·
1 Parent(s): 954c782

Add model card: attribution, licences, training config

Browse files
Files changed (1) hide show
  1. README.md +89 -1
README.md CHANGED
@@ -1,3 +1,91 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: cc-by-4.0
3
+ base_model: Wan-AI/Wan2.1-T2V-1.3B
4
+ pipeline_tag: text-to-video
5
+ tags:
6
+ - world-model
7
+ - video-generation
8
+ - action-conditioned
9
+ - memory
10
+ - ablation
11
+ - research-artifact
12
  ---
13
+
14
+ # echo — Echo-Memory ablation arm (`ucpe` + two-chunk memory)
15
+
16
+ > **This is an unofficial derivative artifact, not the official Echo-Memory release.**
17
+ > It contains one ablation arm re-trained from the Echo-Memory codebase, produced for
18
+ > internal study. For the official code, paper and checkpoints, use the links below.
19
+
20
+ ## Upstream / attribution
21
+
22
+ | | |
23
+ |---|---|
24
+ | Original work | **Echo-Memory: A Controlled Study of Memory in Action World Models** |
25
+ | Authors | Echo Team @ Joy Future Academy, JD |
26
+ | Paper | [arXiv:2606.09803](https://arxiv.org/abs/2606.09803) |
27
+ | Official code | https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory |
28
+ | Official checkpoints | https://huggingface.co/Echo-Team/Echo-Memory |
29
+ | Code license | CC BY 4.0 |
30
+ | Base model | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) (Apache 2.0) |
31
+
32
+ The Echo-Memory code included here is redistributed under CC BY 4.0 with attribution to
33
+ the Echo Team. The weights are derived from Wan2.1-T2V-1.3B, which is Apache 2.0; that
34
+ license and its notices continue to apply to the derived weights.
35
+
36
+ ## What this repository contains
37
+
38
+ ```
39
+ code/ Echo-Memory codebase as used for this run
40
+ checkpoints/
41
+ Step-10000.safetensors 3.5 GB
42
+ Step-20000.safetensors 3.5 GB
43
+ Step-30000.safetensors 3.5 GB (final, max_train_steps = 30000)
44
+ ```
45
+
46
+ ## Training configuration
47
+
48
+ Single arm of a memory-mechanism ablation, run name
49
+ `memory_baselines_basic_abl_ucpe_memory_two_chunk`.
50
+
51
+ - Base weights: `Wan2.1-T2V-1.3B` (DiT + `umt5-xxl` text encoder + `Wan2.1_VAE`)
52
+ - Trainable: `dit` only, `--remove_prefix_in_ckpt pipe.dit.`
53
+ - Memory: `--enable_context_memory --context_source replay`
54
+ `--prev_chunk_frames 81 --context_memory_frames 5`
55
+ - Mechanism under test: `--use_cgla_memory --cgla_mechanism ucpe`
56
+ `--cgla_every_n_blocks 4 --cgla_aux_loss_weight 0.01`
57
+ - Also enabled: `--use_moc --moc_temperature 1.0`, `--train_cam_pose`,
58
+ `--add_action_attn`, `--use_rt_relative`, `--use_anchor_frame`, `--cfg_target_only`
59
+ - Resolution / length: 352 x 640, 81 frames
60
+ - Optimisation: lr 2e-5, 1 epoch, batch 1/device, grad-accum 1,
61
+ `--timestep_shift 15`, `--context_drop_prob 0.1`, 30,000 steps
62
+ - Hardware: 1x NVIDIA H20
63
+
64
+ ## Data — not redistributed here
65
+
66
+ Training used the **Context-as-Memory** dataset (Unreal-Engine rendered environments,
67
+ ~331 GB of frames). It is **not** included in this repository: it is third-party data
68
+ and the copy used here carried no redistribution licence. Obtain it from its original
69
+ source.
70
+
71
+ ## Status and caveats
72
+
73
+ - This is **one arm of an ablation sweep**, uploaded as a research artifact.
74
+ Its results had not been analysed at the time of upload — no quality claim is made,
75
+ and it should not be read as the best or recommended configuration.
76
+ - It is **not** a reproduction of, or a replacement for, the official Echo-Memory
77
+ checkpoints. Comparisons against the paper's numbers are not valid without matching
78
+ the official evaluation protocol.
79
+
80
+ ## Citation
81
+
82
+ Please cite the original work:
83
+
84
+ ```bibtex
85
+ @article{echomemory2026,
86
+ title = {Echo-Memory: A Controlled Study of Memory in Action World Models},
87
+ author = {Echo Team, Joy Future Academy, JD},
88
+ journal= {arXiv preprint arXiv:2606.09803},
89
+ year = {2026}
90
+ }
91
+ ```