Text-to-Video
Diffusers
Safetensors
world-model
video-generation
image-to-video
interactive
distillation
Instructions to use AlayaLab/Evoke with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AlayaLab/Evoke with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AlayaLab/Evoke", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Add model card
Browse files
README.md
CHANGED
|
@@ -1,3 +1,81 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: text-to-video
|
| 4 |
+
inference: false
|
| 5 |
+
tags:
|
| 6 |
+
- world-model
|
| 7 |
+
- video-generation
|
| 8 |
+
- text-to-video
|
| 9 |
+
- image-to-video
|
| 10 |
+
- interactive
|
| 11 |
+
- distillation
|
| 12 |
---
|
| 13 |
+
|
| 14 |
+
<h1 align="center">Alaya-EVOKE: From Linear-Scaling Supervision to Endless World</h1>
|
| 15 |
+
|
| 16 |
+
<p align="center">
|
| 17 |
+
<a href="https://github.com/SII-YuanyangYin/Evoke"><img src="https://img.shields.io/badge/GitHub-SII--YuanyangYin/Evoke-181717.svg?logo=github" alt="GitHub"></a>
|
| 18 |
+
<a href="https://evoke-world.github.io/Evoke/"><img src="https://img.shields.io/badge/π_Project_Page-evoke--world.github.io-1a73e8.svg" alt="Project Page"></a>
|
| 19 |
+
<a href="#"><img src="https://img.shields.io/badge/arXiv-coming_soon-b31b1b.svg" alt="arXiv"></a>
|
| 20 |
+
</p>
|
| 21 |
+
|
| 22 |
+
Model weights for **EVOKE**, a 3-step, CFG-free interactive world model that generates
|
| 23 |
+
**384 Γ 640 @ 24 fps** video and stays coherent over 30 s rollouts. Code, docs and demos live in the
|
| 24 |
+
GitHub repository β **this repository holds weights only.**
|
| 25 |
+
|
| 26 |
+
- β‘ **3 steps, zero CFG** β 1.5 s of video every 2.11 s on one H200, one forward per step.
|
| 27 |
+
- π **Endless, not windowed** β scene geometry lives in an external camera-indexed world state bank,
|
| 28 |
+
so the denoiser context stays bounded however long the session runs.
|
| 29 |
+
- ποΈ **Re-promptable mid-flight** β change the prompt while the rollout is running, no cut, no restart.
|
| 30 |
+
|
| 31 |
+
## Contents
|
| 32 |
+
|
| 33 |
+
Every EVOKE directory is the **parent** of a `transformer/`, because it loads as
|
| 34 |
+
`from_pretrained(path, subfolder="transformer")`.
|
| 35 |
+
|
| 36 |
+
```
|
| 37 |
+
evoke-base/ vae / text_encoder / tokenizer / scheduler only
|
| 38 |
+
evoke/
|
| 39 |
+
βββ stage1_camera_control/transformer/ multi-step camera-controllable model
|
| 40 |
+
βββ stage2_few_step_training/transformer/ few-step distillation (3-step pyramid)
|
| 41 |
+
βββ stage3_long_distillation/transformer/ 30 s long-video distillation (post-distill init)
|
| 42 |
+
βββ stage3_post_distillation/transformer/ the shipped model
|
| 43 |
+
βββ evoke_teacher/{high,low}_noise/ the two DMD teacher experts -- training only
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
## Usage
|
| 47 |
+
|
| 48 |
+
```bash
|
| 49 |
+
git clone https://github.com/SII-YuanyangYin/Evoke && cd Evoke
|
| 50 |
+
pip install -r requirements.txt
|
| 51 |
+
|
| 52 |
+
huggingface-cli download SII-YuanyangYin/Evoke --local-dir models
|
| 53 |
+
huggingface-cli download pkqbajng/ViGeo --local-dir models/ViGeo1.1 # REQUIRED depth backend
|
| 54 |
+
|
| 55 |
+
MODE=t2v NUM_CHUNKS=20 bash scripts/inference/infer_post_distill.sh
|
| 56 |
+
```
|
| 57 |
+
|
| 58 |
+
`ViGeo` is a separate download and is **required** β every shipped recipe uses it as the depth backend
|
| 59 |
+
behind the world state bank. Depth-Anything-3 is optional. Both ship under CC-BY-NC-4.0, which is more
|
| 60 |
+
restrictive than this repository's Apache-2.0; check their licences before any commercial use.
|
| 61 |
+
|
| 62 |
+
Inference modes, the mode Γ model matrix, hour-scale rollouts and training are documented in the
|
| 63 |
+
GitHub repository.
|
| 64 |
+
|
| 65 |
+
## Notes
|
| 66 |
+
|
| 67 |
+
The distilled models were trained on v2v conditioning alone, so `MODE=i2v|t2v` on them is **zero-shot**;
|
| 68 |
+
only `stage1_camera_control` has all three modes in distribution.
|
| 69 |
+
|
| 70 |
+
The vae / text encoder / tokenizer / scheduler in `evoke-base/` come from the released
|
| 71 |
+
[Helios](https://github.com/PKU-YuanGroup/Helios) base, which traces them to Wan. The EVOKE teacher is
|
| 72 |
+
built on [LingBot-World](https://github.com/robbyant/lingbot-world).
|
| 73 |
+
|
| 74 |
+
## Citation
|
| 75 |
+
|
| 76 |
+
```bibtex
|
| 77 |
+
@article{evoke2026,
|
| 78 |
+
title = {Alaya-EVOKE: From Linear-Scaling Supervision to Endless World},
|
| 79 |
+
year = {2026},
|
| 80 |
+
}
|
| 81 |
+
```
|