Instructions to use gangweix/next-forcing-posttrain-robotwin with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use gangweix/next-forcing-posttrain-robotwin with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("gangweix/next-forcing-posttrain-robotwin", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,106 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
pipeline_tag: robotics
|
| 5 |
+
tags:
|
| 6 |
+
- robotics
|
| 7 |
+
- world-model
|
| 8 |
+
- video-generation
|
| 9 |
+
- vision-action
|
| 10 |
+
- next-forcing
|
| 11 |
+
- robotwin
|
| 12 |
---
|
| 13 |
+
|
| 14 |
+
# Next Forcing — RoboTwin Post-trained Checkpoint
|
| 15 |
+
|
| 16 |
+
Post-trained checkpoint for **Next Forcing: Causal World Modeling with
|
| 17 |
+
Multi-Chunk Prediction**, evaluated on the RoboTwin 2.0 benchmark.
|
| 18 |
+
|
| 19 |
+
- 📄 Paper: https://arxiv.org/pdf/2606.11187
|
| 20 |
+
- 🌐 Project page: https://gangweix.github.io/next-forcing/
|
| 21 |
+
- 💻 Code: https://github.com/gangweix/next-forcing
|
| 22 |
+
|
| 23 |
+
## Model Description
|
| 24 |
+
|
| 25 |
+
Next Forcing addresses the myopic supervision problem in autoregressive video
|
| 26 |
+
world models: next-chunk denoising tends to learn local appearance shortcuts
|
| 27 |
+
instead of long-range dynamics, especially at high frame rates. Lightweight
|
| 28 |
+
**Multi-Chunk Prediction (MCP)** modules predict multiple future chunks through
|
| 29 |
+
a causal chain during training, providing dense temporal supervision to the
|
| 30 |
+
backbone.
|
| 31 |
+
|
| 32 |
+
This checkpoint is the RoboTwin post-trained model, built on top of the
|
| 33 |
+
[LingBot-VA](https://github.com/Robbyant/lingbot-va) codebase. It was post-trained
|
| 34 |
+
from [`gangweix/next-forcing-base`](https://huggingface.co/gangweix/next-forcing-base).
|
| 35 |
+
|
| 36 |
+
| | |
|
| 37 |
+
| --- | --- |
|
| 38 |
+
| Parameters | 6.7B (BF16) |
|
| 39 |
+
| Backbone layers | 30 |
|
| 40 |
+
| MCP depths | 3 (`mcp_blocks_per_depth=3`, collect layers `[3, 11, 19, 29]`) |
|
| 41 |
+
| Benchmark | RoboTwin 2.0, 50 bimanual manipulation tasks |
|
| 42 |
+
| Initialized from | [`next-forcing-base`](https://huggingface.co/gangweix/next-forcing-base) (5.1B) |
|
| 43 |
+
|
| 44 |
+
## Results
|
| 45 |
+
|
| 46 |
+
Average success rate on RoboTwin 2.0:
|
| 47 |
+
|
| 48 |
+
| Setting | LingBot-VA | **Next Forcing** |
|
| 49 |
+
| --- | ---: | ---: |
|
| 50 |
+
| Clean | 92.9 | **94.1** |
|
| 51 |
+
| Random | 91.5 | **93.5** |
|
| 52 |
+
|
| 53 |
+
## Repository Layout
|
| 54 |
+
|
| 55 |
+
```text
|
| 56 |
+
transformer/ Next Forcing backbone with MCP modules (enable_mcp=true)
|
| 57 |
+
vae/
|
| 58 |
+
text_encoder/
|
| 59 |
+
tokenizer/
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
## Usage
|
| 63 |
+
|
| 64 |
+
Clone the code and install the dependencies as described in the
|
| 65 |
+
[repository README](https://github.com/gangweix/next-forcing).
|
| 66 |
+
|
| 67 |
+
```bash
|
| 68 |
+
python -m pip install "huggingface_hub[cli]"
|
| 69 |
+
hf download gangweix/next-forcing-posttrain-robotwin \
|
| 70 |
+
--local-dir ./checkpoints/next-forcing-posttrain-robotwin
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
The evaluation code resolves model subfolders by path, so point
|
| 74 |
+
`NEXT_FORCING_MODEL_PATH` at the **local directory**, not at the Hub repository
|
| 75 |
+
id:
|
| 76 |
+
|
| 77 |
+
```bash
|
| 78 |
+
export NEXT_FORCING_MODEL_PATH=$PWD/checkpoints/next-forcing-posttrain-robotwin
|
| 79 |
+
export ROBOTWIN_ROOT=/path/to/your/RoboTwin
|
| 80 |
+
|
| 81 |
+
# Start the inference server on one GPU
|
| 82 |
+
CUDA_VISIBLE_DEVICES=0 bash evaluation/robotwin/launch_server.sh
|
| 83 |
+
|
| 84 |
+
# In another terminal, evaluate one task for 100 trials
|
| 85 |
+
bash evaluation/robotwin/launch_client.sh /path/to/eval_results adjust_bottle
|
| 86 |
+
```
|
| 87 |
+
|
| 88 |
+
RoboTwin evaluation requires a working RoboTwin 2.0 installation; see the
|
| 89 |
+
[official guide](https://robotwin-platform.github.io/doc/usage/robotwin-install.html).
|
| 90 |
+
|
| 91 |
+
## License
|
| 92 |
+
|
| 93 |
+
Released under the Apache License 2.0. Next Forcing is developed on top of the
|
| 94 |
+
LingBot-VA codebase; please retain the upstream attribution and license when
|
| 95 |
+
redistributing.
|
| 96 |
+
|
| 97 |
+
## Citation
|
| 98 |
+
|
| 99 |
+
```bibtex
|
| 100 |
+
@article{xu2026next,
|
| 101 |
+
title={Next Forcing: Causal World Modeling with Multi-Chunk Prediction},
|
| 102 |
+
author={Xu, Gangwei and Zhang, Qihang and Zhou, Jiaming and Zhu, Xing and Shen, Yujun and Yang, Xin and Xu, Yinghao},
|
| 103 |
+
journal={arXiv preprint arXiv:2606.11187},
|
| 104 |
+
year={2026}
|
| 105 |
+
}
|
| 106 |
+
```
|