gangweix commited on
Commit
4c47db4
·
verified ·
1 Parent(s): 4434e52

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -0
README.md CHANGED
@@ -1,3 +1,106 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: diffusers
4
+ pipeline_tag: robotics
5
+ tags:
6
+ - robotics
7
+ - world-model
8
+ - video-generation
9
+ - vision-action
10
+ - next-forcing
11
+ - robotwin
12
  ---
13
+
14
+ # Next Forcing — RoboTwin Post-trained Checkpoint
15
+
16
+ Post-trained checkpoint for **Next Forcing: Causal World Modeling with
17
+ Multi-Chunk Prediction**, evaluated on the RoboTwin 2.0 benchmark.
18
+
19
+ - 📄 Paper: https://arxiv.org/pdf/2606.11187
20
+ - 🌐 Project page: https://gangweix.github.io/next-forcing/
21
+ - 💻 Code: https://github.com/gangweix/next-forcing
22
+
23
+ ## Model Description
24
+
25
+ Next Forcing addresses the myopic supervision problem in autoregressive video
26
+ world models: next-chunk denoising tends to learn local appearance shortcuts
27
+ instead of long-range dynamics, especially at high frame rates. Lightweight
28
+ **Multi-Chunk Prediction (MCP)** modules predict multiple future chunks through
29
+ a causal chain during training, providing dense temporal supervision to the
30
+ backbone.
31
+
32
+ This checkpoint is the RoboTwin post-trained model, built on top of the
33
+ [LingBot-VA](https://github.com/Robbyant/lingbot-va) codebase. It was post-trained
34
+ from [`gangweix/next-forcing-base`](https://huggingface.co/gangweix/next-forcing-base).
35
+
36
+ | | |
37
+ | --- | --- |
38
+ | Parameters | 6.7B (BF16) |
39
+ | Backbone layers | 30 |
40
+ | MCP depths | 3 (`mcp_blocks_per_depth=3`, collect layers `[3, 11, 19, 29]`) |
41
+ | Benchmark | RoboTwin 2.0, 50 bimanual manipulation tasks |
42
+ | Initialized from | [`next-forcing-base`](https://huggingface.co/gangweix/next-forcing-base) (5.1B) |
43
+
44
+ ## Results
45
+
46
+ Average success rate on RoboTwin 2.0:
47
+
48
+ | Setting | LingBot-VA | **Next Forcing** |
49
+ | --- | ---: | ---: |
50
+ | Clean | 92.9 | **94.1** |
51
+ | Random | 91.5 | **93.5** |
52
+
53
+ ## Repository Layout
54
+
55
+ ```text
56
+ transformer/ Next Forcing backbone with MCP modules (enable_mcp=true)
57
+ vae/
58
+ text_encoder/
59
+ tokenizer/
60
+ ```
61
+
62
+ ## Usage
63
+
64
+ Clone the code and install the dependencies as described in the
65
+ [repository README](https://github.com/gangweix/next-forcing).
66
+
67
+ ```bash
68
+ python -m pip install "huggingface_hub[cli]"
69
+ hf download gangweix/next-forcing-posttrain-robotwin \
70
+ --local-dir ./checkpoints/next-forcing-posttrain-robotwin
71
+ ```
72
+
73
+ The evaluation code resolves model subfolders by path, so point
74
+ `NEXT_FORCING_MODEL_PATH` at the **local directory**, not at the Hub repository
75
+ id:
76
+
77
+ ```bash
78
+ export NEXT_FORCING_MODEL_PATH=$PWD/checkpoints/next-forcing-posttrain-robotwin
79
+ export ROBOTWIN_ROOT=/path/to/your/RoboTwin
80
+
81
+ # Start the inference server on one GPU
82
+ CUDA_VISIBLE_DEVICES=0 bash evaluation/robotwin/launch_server.sh
83
+
84
+ # In another terminal, evaluate one task for 100 trials
85
+ bash evaluation/robotwin/launch_client.sh /path/to/eval_results adjust_bottle
86
+ ```
87
+
88
+ RoboTwin evaluation requires a working RoboTwin 2.0 installation; see the
89
+ [official guide](https://robotwin-platform.github.io/doc/usage/robotwin-install.html).
90
+
91
+ ## License
92
+
93
+ Released under the Apache License 2.0. Next Forcing is developed on top of the
94
+ LingBot-VA codebase; please retain the upstream attribution and license when
95
+ redistributing.
96
+
97
+ ## Citation
98
+
99
+ ```bibtex
100
+ @article{xu2026next,
101
+ title={Next Forcing: Causal World Modeling with Multi-Chunk Prediction},
102
+ author={Xu, Gangwei and Zhang, Qihang and Zhou, Jiaming and Zhu, Xing and Shen, Yujun and Yang, Xin and Xu, Yinghao},
103
+ journal={arXiv preprint arXiv:2606.11187},
104
+ year={2026}
105
+ }
106
+ ```