Image-to-Video
Diffusers
Safetensors
Wan2.2
English
Chinese
WanPipeline
video-generation
visual-reasoning
reinforcement-learning
rlvr
vbvr-pro
Instructions to use Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Wan2.2
How to use Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Align model card style with VBVR-Pro releases
#2
by pufanyi - opened
README.md
CHANGED
|
@@ -21,7 +21,63 @@ tags:
|
|
| 21 |
- vbvr-pro
|
| 22 |
---
|
| 23 |
|
| 24 |
-
# VBVR-Pro
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
This repository contains a complete Diffusers checkpoint for the VBVR-Pro
|
| 27 |
Wan2.2 TI2V-5B model optimized with reinforcement learning with verifiable
|
|
@@ -31,11 +87,11 @@ and is intended for research on image-conditioned video generation and visual
|
|
| 31 |
reasoning.
|
| 32 |
|
| 33 |
The repository includes the transformer, text encoder, tokenizer, VAE, and
|
| 34 |
-
scheduler. It
|
| 35 |
image-to-video pipeline exposing all six inference configurations evaluated in
|
| 36 |
the VBVR-Pro paper.
|
| 37 |
|
| 38 |
-
##
|
| 39 |
|
| 40 |
The sampler is selected per call; the model weights do not change.
|
| 41 |
|
|
@@ -53,7 +109,7 @@ matched settings below. The model was trained with Flow-CPS coefficient 0.7.
|
|
| 53 |
Reported scores are evaluation results, not guarantees for other prompts or
|
| 54 |
runtime configurations.
|
| 55 |
|
| 56 |
-
## Recommended evaluation settings
|
| 57 |
|
| 58 |
- Resolution: 512 × 512
|
| 59 |
- Frames: 81
|
|
@@ -61,7 +117,9 @@ runtime configurations.
|
|
| 61 |
- Inference steps: 30
|
| 62 |
- Guidance scale: 1.0
|
| 63 |
|
| 64 |
-
##
|
|
|
|
|
|
|
| 65 |
|
| 66 |
Use Diffusers 0.37.1 or newer. Because this loads Python code from the model
|
| 67 |
repository, review `pipeline.py`, pass `trust_remote_code=True`, and pin a
|
|
@@ -113,7 +171,7 @@ default, the fresh Flow-CPS transition noise. Pass a separate
|
|
| 113 |
Loading the complete pipeline requires substantial CPU and accelerator
|
| 114 |
memory. CPU offloading is recommended on smaller GPUs.
|
| 115 |
|
| 116 |
-
## Standard Diffusers
|
| 117 |
|
| 118 |
The bundled scheduler remains UniPC and `model_index.json` is unchanged. Users
|
| 119 |
who only need the standard deterministic path can load the checkpoint without
|
|
@@ -153,13 +211,15 @@ does not accept the first-frame `image` argument in Diffusers 0.37.1.
|
|
| 153 |
formal score provenance. Exact output bytes can vary with PyTorch,
|
| 154 |
Diffusers, attention backend, dtype, and device.
|
| 155 |
|
| 156 |
-
## Training
|
|
|
|
|
|
|
| 157 |
|
| 158 |
The model was optimized on VBVR-Pro image-to-video tasks using Flow-CPS
|
| 159 |
rollouts and deterministic task-specific rule rewards. Training and evaluation
|
| 160 |
targeted 512 × 512 videos with 81 frames.
|
| 161 |
|
| 162 |
-
##
|
| 163 |
|
| 164 |
- Release training code: [`pufanyi/vbvr-rl`](https://github.com/pufanyi/vbvr-rl)
|
| 165 |
- Training dataset: [`Video-Reason/VBVR-Pro-RL`](https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL), revision `ca0aaffea93b07d269c6fe2fbfe533f1fdab9aa1`
|
|
@@ -173,9 +233,21 @@ targeted 512 × 512 videos with 81 frames.
|
|
| 173 |
model and its training data.
|
| 174 |
- Do not use generated outputs as the sole basis for high-stakes decisions.
|
| 175 |
|
| 176 |
-
## License
|
| 177 |
|
| 178 |
The model is released under Apache License 2.0. See `LICENSE`. Please also
|
| 179 |
follow the terms and attribution guidance of the upstream Wan2.2 model.
|
| 180 |
|
| 181 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
- vbvr-pro
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
|
| 25 |
+
|
| 26 |
+
<div align="center">
|
| 27 |
+
|
| 28 |
+
<p align="center">
|
| 29 |
+
<a href="https://video-reason.com/?v=pro" target="_blank">
|
| 30 |
+
<img alt="Project Page" src="https://img.shields.io/badge/Project%20-%20Homepage-4285F4" height="20" />
|
| 31 |
+
</a>
|
| 32 |
+
<a href="https://huggingface.co/papers/2608.26105" target="_blank">
|
| 33 |
+
<img alt="arXiv" src="https://img.shields.io/badge/arXiv-VBVR_Pro-red?logo=arxiv" height="20" />
|
| 34 |
+
</a>
|
| 35 |
+
<a href="https://github.com/Video-Reason/VBVR-Pro" target="_blank">
|
| 36 |
+
<img alt="Training and Inference" src="https://img.shields.io/badge/Training_&_Inference-VBVR_Pro-100000?style=flat-square&logo=github&logoColor=white" height="20" />
|
| 37 |
+
</a>
|
| 38 |
+
<a href="https://github.com/Video-Reason/VBVR-Pro-Bench" target="_blank">
|
| 39 |
+
<img alt="Evaluation Code" src="https://img.shields.io/badge/Evaluation_code-VBVR_Pro_Bench-100000?style=flat-square&logo=github&logoColor=white" height="20" />
|
| 40 |
+
</a>
|
| 41 |
+
<a href="https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL" target="_blank">
|
| 42 |
+
<img alt="RL Dataset" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_RL-Dataset-ffc107?color=ffc107&logoColor=white" height="20" />
|
| 43 |
+
</a>
|
| 44 |
+
<a href="https://huggingface.co/datasets/Video-Reason/VBVR-Pro-Bench/tree/main" target="_blank">
|
| 45 |
+
<img alt="Bench Data" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_Bench-Data-ffc107?color=ffc107&logoColor=white" height="20" />
|
| 46 |
+
</a>
|
| 47 |
+
<a href="https://video-reason.com/pro/bench/#leaderboard" target="_blank">
|
| 48 |
+
<img alt="Leaderboard" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_Bench-Leaderboard-ffc107?color=ffc107&logoColor=white" height="20" />
|
| 49 |
+
</a>
|
| 50 |
+
</p>
|
| 51 |
+
|
| 52 |
+
</div>
|
| 53 |
+
|
| 54 |
+
## Overview
|
| 55 |
+
|
| 56 |
+
Native visual reasoning, i.e., reasoning through visual generation, has recently emerged as a promising direction for studying visual intelligence beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce **VBVR-Pro**, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. **1) Task scaling.** VBVR-Pro turns visual reasoning into a controlled task space of *300* procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across *six* held-out visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. Further analysis validates that these gains reflect visual reasoning rather than instruction-pattern fitting. **2) Verifiable rewards.** VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent *VLM-as-a-judge* paradigm. In contrast, the proposed scorers are grounded on verifiable task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. **3) Mechanism study.** VBVR-Pro enables controlled modality studies across more than *30* image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative by externalizing intermediate visual states. Critically, ablations and probing confirm the presence of vision-native trajectories, that are a more crucial substrate than explicit linguistic chains of thought for visual reasoning. We release all data, models, scorers, and code to facilitate future research.
|
| 57 |
+
|
| 58 |
+
The models are presented in the paper [VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning](https://huggingface.co/papers/2608.26105).
|
| 59 |
+
|
| 60 |
+
## Models Zoo
|
| 61 |
+
|
| 62 |
+
<table border="1" cellspacing="0" cellpadding="4" style="border-collapse: collapse; width: 100%;">
|
| 63 |
+
<thead>
|
| 64 |
+
<tr>
|
| 65 |
+
<th>Model</th>
|
| 66 |
+
<th>Base Architecture</th>
|
| 67 |
+
<th>Other Remarks</th>
|
| 68 |
+
</tr>
|
| 69 |
+
</thead>
|
| 70 |
+
<tbody>
|
| 71 |
+
<tr style="border-top: 4px solid #6b7280; background-color: #e5e7eb;"><th colspan="3" align="left">Video Generation Models</th></tr>
|
| 72 |
+
<tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B">VBVR-Pro-Wan2.2-TI2V-5B</a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, supervised fine-tuning</td></tr>
|
| 73 |
+
<tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR"><strong>VBVR-Pro-Wan2.2-TI2V-5B-RLVR</strong></a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, RL with verifiable rewards</td></tr>
|
| 74 |
+
<tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVLM-Qwen3.6-27B-Reward">VBVR-Pro-Wan2.2-TI2V-5B-RLVLM-Qwen3.6-27B-Reward</a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, RL with Qwen3.6-27B VLM rewards</td></tr>
|
| 75 |
+
</tbody>
|
| 76 |
+
</table>
|
| 77 |
+
|
| 78 |
+
## Release Information
|
| 79 |
+
|
| 80 |
+
### VBVR-Pro-Wan2.2-TI2V-5B-RLVR
|
| 81 |
|
| 82 |
This repository contains a complete Diffusers checkpoint for the VBVR-Pro
|
| 83 |
Wan2.2 TI2V-5B model optimized with reinforcement learning with verifiable
|
|
|
|
| 87 |
reasoning.
|
| 88 |
|
| 89 |
The repository includes the transformer, text encoder, tokenizer, VAE, and
|
| 90 |
+
scheduler. It also includes [`pipeline.py`](./pipeline.py), a custom
|
| 91 |
image-to-video pipeline exposing all six inference configurations evaluated in
|
| 92 |
the VBVR-Pro paper.
|
| 93 |
|
| 94 |
+
## VBVR-Pro Benchmark Results
|
| 95 |
|
| 96 |
The sampler is selected per call; the model weights do not change.
|
| 97 |
|
|
|
|
| 109 |
Reported scores are evaluation results, not guarantees for other prompts or
|
| 110 |
runtime configurations.
|
| 111 |
|
| 112 |
+
### Recommended evaluation settings
|
| 113 |
|
| 114 |
- Resolution: 512 × 512
|
| 115 |
- Frames: 81
|
|
|
|
| 117 |
- Inference steps: 30
|
| 118 |
- Guidance scale: 1.0
|
| 119 |
|
| 120 |
+
## Quick Start
|
| 121 |
+
|
| 122 |
+
### Custom sampler pipeline
|
| 123 |
|
| 124 |
Use Diffusers 0.37.1 or newer. Because this loads Python code from the model
|
| 125 |
repository, review `pipeline.py`, pass `trust_remote_code=True`, and pin a
|
|
|
|
| 171 |
Loading the complete pipeline requires substantial CPU and accelerator
|
| 172 |
memory. CPU offloading is recommended on smaller GPUs.
|
| 173 |
|
| 174 |
+
### Standard Diffusers pipeline
|
| 175 |
|
| 176 |
The bundled scheduler remains UniPC and `model_index.json` is unchanged. Users
|
| 177 |
who only need the standard deterministic path can load the checkpoint without
|
|
|
|
| 211 |
formal score provenance. Exact output bytes can vary with PyTorch,
|
| 212 |
Diffusers, attention backend, dtype, and device.
|
| 213 |
|
| 214 |
+
## Training Details
|
| 215 |
+
|
| 216 |
+
### Summary
|
| 217 |
|
| 218 |
The model was optimized on VBVR-Pro image-to-video tasks using Flow-CPS
|
| 219 |
rollouts and deterministic task-specific rule rewards. Training and evaluation
|
| 220 |
targeted 512 × 512 videos with 81 frames.
|
| 221 |
|
| 222 |
+
### Resources
|
| 223 |
|
| 224 |
- Release training code: [`pufanyi/vbvr-rl`](https://github.com/pufanyi/vbvr-rl)
|
| 225 |
- Training dataset: [`Video-Reason/VBVR-Pro-RL`](https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL), revision `ca0aaffea93b07d269c6fe2fbfe533f1fdab9aa1`
|
|
|
|
| 233 |
model and its training data.
|
| 234 |
- Do not use generated outputs as the sole basis for high-stakes decisions.
|
| 235 |
|
| 236 |
+
## License
|
| 237 |
|
| 238 |
The model is released under Apache License 2.0. See `LICENSE`. Please also
|
| 239 |
follow the terms and attribution guidance of the upstream Wan2.2 model.
|
| 240 |
|
| 241 |
+
## Citation
|
| 242 |
+
|
| 243 |
+
```bibtex
|
| 244 |
+
@misc{xu2026vbvrproscalableverifiablesuite,
|
| 245 |
+
title={VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning},
|
| 246 |
+
author={Junxiang Xu and Ruisi Wang and Fanyi Pu and Maijunxian Wang and Ran Ji and Tongxi Zhou and Chenyang Gu and Jing Zuo and Hongcan Xiao and Yimeng Geng and Wanqi Yin and Wei Chen and Oscar Qian and Zhengan Yan and Ziqi Huang and Haiwen Diao and Liang Pan and Bo Li and Xiangyu Fan and Dezhi Luo and Fengyuan Yu and Zehong Zhao and Qingying Gao and Tinghui Zhu and Yilan Zhang and Jingqi Tong and Pinyuan Feng and Zhengze Jiang and Letian Wang and Ziyu Guo and Renrui Zhang and Jieneng Chen and Sonia Joseph and Constantin Venhoff and Saman Motamed and Mengyue Yang and Chandra Sripada and Alan Yuille and Philip Torr and Lvmin Zhang and Vikash Kumar and Daniel Khashabi and Nikolaus Kriegeskorte and Raphaël Millière and Vincent C. Müller and Anyi Rao and Quan Wang and Ziwei Liu and Dahua Lin and Lei Yang and Hokin Deng and Zhongang Cai},
|
| 247 |
+
year={2026},
|
| 248 |
+
eprint={2608.26105},
|
| 249 |
+
archivePrefix={arXiv},
|
| 250 |
+
primaryClass={cs.CV},
|
| 251 |
+
url={https://arxiv.org/abs/2608.26105},
|
| 252 |
+
}
|
| 253 |
+
```
|