SII-YuanyangYin commited on
Commit
2cfd4ad
Β·
verified Β·
1 Parent(s): b22b92a

Add model card

Browse files
Files changed (1) hide show
  1. README.md +79 -1
README.md CHANGED
@@ -1,3 +1,81 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-to-video
4
+ inference: false
5
+ tags:
6
+ - world-model
7
+ - video-generation
8
+ - text-to-video
9
+ - image-to-video
10
+ - interactive
11
+ - distillation
12
  ---
13
+
14
+ <h1 align="center">Alaya-EVOKE: From Linear-Scaling Supervision to Endless World</h1>
15
+
16
+ <p align="center">
17
+ <a href="https://github.com/SII-YuanyangYin/Evoke"><img src="https://img.shields.io/badge/GitHub-SII--YuanyangYin/Evoke-181717.svg?logo=github" alt="GitHub"></a>
18
+ <a href="https://evoke-world.github.io/Evoke/"><img src="https://img.shields.io/badge/🌐_Project_Page-evoke--world.github.io-1a73e8.svg" alt="Project Page"></a>
19
+ <a href="#"><img src="https://img.shields.io/badge/arXiv-coming_soon-b31b1b.svg" alt="arXiv"></a>
20
+ </p>
21
+
22
+ Model weights for **EVOKE**, a 3-step, CFG-free interactive world model that generates
23
+ **384 Γ— 640 @ 24 fps** video and stays coherent over 30 s rollouts. Code, docs and demos live in the
24
+ GitHub repository β€” **this repository holds weights only.**
25
+
26
+ - ⚑ **3 steps, zero CFG** β€” 1.5 s of video every 2.11 s on one H200, one forward per step.
27
+ - 🌍 **Endless, not windowed** β€” scene geometry lives in an external camera-indexed world state bank,
28
+ so the denoiser context stays bounded however long the session runs.
29
+ - πŸŽ›οΈ **Re-promptable mid-flight** β€” change the prompt while the rollout is running, no cut, no restart.
30
+
31
+ ## Contents
32
+
33
+ Every EVOKE directory is the **parent** of a `transformer/`, because it loads as
34
+ `from_pretrained(path, subfolder="transformer")`.
35
+
36
+ ```
37
+ evoke-base/ vae / text_encoder / tokenizer / scheduler only
38
+ evoke/
39
+ β”œβ”€β”€ stage1_camera_control/transformer/ multi-step camera-controllable model
40
+ β”œβ”€β”€ stage2_few_step_training/transformer/ few-step distillation (3-step pyramid)
41
+ β”œβ”€β”€ stage3_long_distillation/transformer/ 30 s long-video distillation (post-distill init)
42
+ β”œβ”€β”€ stage3_post_distillation/transformer/ the shipped model
43
+ └── evoke_teacher/{high,low}_noise/ the two DMD teacher experts -- training only
44
+ ```
45
+
46
+ ## Usage
47
+
48
+ ```bash
49
+ git clone https://github.com/SII-YuanyangYin/Evoke && cd Evoke
50
+ pip install -r requirements.txt
51
+
52
+ huggingface-cli download SII-YuanyangYin/Evoke --local-dir models
53
+ huggingface-cli download pkqbajng/ViGeo --local-dir models/ViGeo1.1 # REQUIRED depth backend
54
+
55
+ MODE=t2v NUM_CHUNKS=20 bash scripts/inference/infer_post_distill.sh
56
+ ```
57
+
58
+ `ViGeo` is a separate download and is **required** β€” every shipped recipe uses it as the depth backend
59
+ behind the world state bank. Depth-Anything-3 is optional. Both ship under CC-BY-NC-4.0, which is more
60
+ restrictive than this repository's Apache-2.0; check their licences before any commercial use.
61
+
62
+ Inference modes, the mode Γ— model matrix, hour-scale rollouts and training are documented in the
63
+ GitHub repository.
64
+
65
+ ## Notes
66
+
67
+ The distilled models were trained on v2v conditioning alone, so `MODE=i2v|t2v` on them is **zero-shot**;
68
+ only `stage1_camera_control` has all three modes in distribution.
69
+
70
+ The vae / text encoder / tokenizer / scheduler in `evoke-base/` come from the released
71
+ [Helios](https://github.com/PKU-YuanGroup/Helios) base, which traces them to Wan. The EVOKE teacher is
72
+ built on [LingBot-World](https://github.com/robbyant/lingbot-world).
73
+
74
+ ## Citation
75
+
76
+ ```bibtex
77
+ @article{evoke2026,
78
+ title = {Alaya-EVOKE: From Linear-Scaling Supervision to Endless World},
79
+ year = {2026},
80
+ }
81
+ ```