armanakbari4 commited on
Commit
d26c24e
·
verified ·
1 Parent(s): 7566180

Add model card

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: diffusers
4
+ tags:
5
+ - robotics
6
+ - world-model
7
+ - diffusion
8
+ - step-distillation
9
+ - lingbot-va
10
+ pipeline_tag: robotics
11
+ ---
12
+
13
+ # Flash-WAM — RoboTwin (distilled)
14
+
15
+ Single-step distilled checkpoint for **Flash-WAM: Modality-Aware Distillation for World Action Models**, applied to LingBot-VA and evaluated on RoboTwin 2.0. Flash-WAM distills each modality with a consistency function matched to its noise regime (linear-gradient-scaling for the action stream, variance-preserving for the video stream), compressing inference to a single step per modality for up to a **23× speedup** while preserving teacher-level task success.
16
+
17
+ This repository contains the **complete model** (distilled transformer + encoders):
18
+
19
+ | Component | Description |
20
+ | :--- | :--- |
21
+ | `transformer/` | Distilled Flash-WAM student |
22
+ | `vae/` | VAE (from the LingBot-VA teacher) |
23
+ | `text_encoder/` | UMT5-XXL text encoder (from the teacher) |
24
+ | `tokenizer/` | T5 tokenizer |
25
+
26
+ ## Links
27
+
28
+ - 📄 Paper: https://arxiv.org/abs/2606.05254
29
+ - 🌐 Project page: https://flashwam.github.io
30
+ - 💻 Code: https://github.com/NU-World-Model-Embodied-AI/Flash-WAM
31
+
32
+ ## Usage
33
+
34
+ For environment setup and evaluation, follow the [Flash-WAM repository](https://github.com/NU-World-Model-Embodied-AI/Flash-WAM) and [LingBot-VA](https://github.com/Robbyant/lingbot-va). Point the inference server at this checkpoint directory.
35
+
36
+ ## Citation
37
+
38
+ ```bibtex
39
+ @misc{akbari2026flashwammodalityawaredistillationworld,
40
+ title={Flash-WAM: Modality-Aware Distillation for World Action Models},
41
+ author={Arman Akbari and Ci Zhang and Arash Akbari and Lin Zhao and Yixiao Chen and Weiwei Chen and Xuan Zhang and Geng Yuan and Yanzhi Wang},
42
+ year={2026},
43
+ eprint={2606.05254},
44
+ archivePrefix={arXiv},
45
+ primaryClass={cs.LG},
46
+ url={https://arxiv.org/abs/2606.05254},
47
+ }
48
+ ```
49
+
50
+ License: Apache-2.0.