TM152 commited on
Commit
da034f7
·
verified ·
1 Parent(s): d5e85bd

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - embodied-ai
6
+ - world-model
7
+ - video-generation
8
+ - mixture-of-experts
9
+ - multi-control
10
+ - model-weights
11
+ ---
12
+
13
+ # Worldscape-MoE Model Weights
14
+
15
+ This repository contains the model weights introduced in the paper:
16
+ [Worldscape-MoE: A Unified Mixture-of-Experts Architecture for Scalable Multi-Control Video Generation World Modeling].
17
+
18
+ Worldscape-MoE is a unified world-model training framework for scalable multi-control video generation. It incorporates a Mixture-of-Experts (MoE) design into Diffusion Transformers to jointly learn from heterogeneous supervisory controls, including camera poses, robotic arms, and hand joints, within a single extensible world model.
19
+
20
+ By combining shared experts for cross-control world knowledge with modality-specific experts for control specialization, Worldscape-MoE enables positive transfer across diverse control modalities and supports strong embodied world modeling, out-of-distribution generalization, and loco-manipulation generation.
21
+
22
+ For more details about the project, please refer to the project page:
23
+ `https://embodiedcity.github.io/Worldscape-MoE/`
24
+
25
+ Demo video:
26
+ `https://www.youtube.com/watch?v=8H3hJ3XDJFk`
27
+
28
+ Paper, arXiv, and model weights will be released soon.
29
+
30
+ ## Citation
31
+
32
+ If this work has contributed to your research, welcome to cite it:
33
+
34
+ ```bibtex
35
+ @misc{fang2026worldscapemoe,
36
+ title = {Worldscape-MoE: A Unified Mixture-of-Experts Architecture for Scalable Multi-Control Video Generation World Modeling},
37
+ author = {Jianjie Fang and Yongyan Xu and Ziyou Wang and Yuchao Huang and Zhaolu Wang and Rongze Tang and Mingyuan Jia and Baining Zhao and Weichen Zhang and Xin Zhang and Haisheng Su and Yu Shang and Chen Gao and Wei Wu and Xinlei Chen and Yong Li},
38
+ year = {2026},
39
+ note = {Project page: https://embodiedcity.github.io/Worldscape-MoE/}
40
+ }
41
+ ```