Update README.md
Browse files
README.md
CHANGED
|
@@ -1,11 +1,12 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
| 4 |
# EWAM: Emergent Depth-Wise Specialization in a Unified Embodied Model
|
| 5 |
|
| 6 |
**From Semantic Understanding through Visual Foresight to Action**
|
| 7 |
|
| 8 |
-
[**Project Page**](https://wanghao00pro.github.io/EWAM-project/) | [**
|
| 9 |
|
| 10 |
EWAM is a unified embodied model that jointly processes vision-language, future-video, and action tokens in a single flow-matching Diffusion Transformer. Without any explicit stage design, the action stream learns a depth-wise division of labor: shallow layers retrieve instruction and current-scene semantics from the vision-language expert, intermediate layers shift toward predicted future-frame representations, and deep layers are dominated by action self-attention for motor refinement.
|
| 11 |
|
|
@@ -62,7 +63,7 @@ The backbone weights are not included. Download [Wan2.2-TI2V-5B](https://hugging
|
|
| 62 |
|
| 63 |
## Usage
|
| 64 |
|
| 65 |
-
Training and evaluation pipelines for RoboTwin 2.0 and LIBERO are provided in the code repository
|
| 66 |
|
| 67 |
## License
|
| 68 |
|
|
@@ -71,10 +72,10 @@ The EWAM weights and code are released under the Apache License 2.0. The Wan2.2
|
|
| 71 |
## Citation
|
| 72 |
|
| 73 |
```bibtex
|
| 74 |
-
@
|
| 75 |
-
title
|
| 76 |
-
author
|
| 77 |
-
|
| 78 |
-
year
|
| 79 |
}
|
| 80 |
```
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
|
| 5 |
# EWAM: Emergent Depth-Wise Specialization in a Unified Embodied Model
|
| 6 |
|
| 7 |
**From Semantic Understanding through Visual Foresight to Action**
|
| 8 |
|
| 9 |
+
[**Project Page**](https://wanghao00pro.github.io/EWAM-project/) | [**Paper (arXiv)**](https://arxiv.org/abs/2609.39973) | [**Code**](https://github.com/Wanghao00pro/EWAM)
|
| 10 |
|
| 11 |
EWAM is a unified embodied model that jointly processes vision-language, future-video, and action tokens in a single flow-matching Diffusion Transformer. Without any explicit stage design, the action stream learns a depth-wise division of labor: shallow layers retrieve instruction and current-scene semantics from the vision-language expert, intermediate layers shift toward predicted future-frame representations, and deep layers are dominated by action self-attention for motor refinement.
|
| 12 |
|
|
|
|
| 63 |
|
| 64 |
## Usage
|
| 65 |
|
| 66 |
+
Training and evaluation pipelines for RoboTwin 2.0 and LIBERO are provided in the [code repository](https://github.com/Wanghao00pro/EWAM). Evaluation requires about 41 GB of GPU memory (A100-80G or H100 recommended); training requires more than 80 GB per GPU.
|
| 67 |
|
| 68 |
## License
|
| 69 |
|
|
|
|
| 72 |
## Citation
|
| 73 |
|
| 74 |
```bibtex
|
| 75 |
+
@article{wang2026ewam,
|
| 76 |
+
title = {{EWAM}: Emergent Depth-Wise Specialization in a Unified Embodied Model -- From Semantic Understanding through Visual Foresight to Action},
|
| 77 |
+
author = {Wang, Hao and Wen, Jiajun and Liu, Jingzhi and Xue, Shuoshuo and Chen, Zhiliang and Lin, Min and Chang, Yicheng and Guo, Xiaoyu and Zhuo, Yukang and Chong, Zheng and Nie, Yunshuang and Zhang, Jian and Liufu, Weijia and Wu, Qingman and Xu, Heming and Song, Bingchang and Wu, Dantong and Wang, Zhiyuan and Xu, Hang and Han, Jianhua and Chen, Bokui and Zhao, Shen and Li, Rui and Liang, Xiaodan},
|
| 78 |
+
journal = {arXiv preprint arXiv:2609.39973},
|
| 79 |
+
year = {2026}
|
| 80 |
}
|
| 81 |
```
|