Align model card style with VBVR-Pro releases

#2
by pufanyi - opened
Files changed (1) hide show
  1. README.md +82 -10
README.md CHANGED
@@ -21,7 +21,63 @@ tags:
21
  - vbvr-pro
22
  ---
23
 
24
- # VBVR-Pro-Wan2.2-TI2V-5B-RLVR
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
  This repository contains a complete Diffusers checkpoint for the VBVR-Pro
27
  Wan2.2 TI2V-5B model optimized with reinforcement learning with verifiable
@@ -31,11 +87,11 @@ and is intended for research on image-conditioned video generation and visual
31
  reasoning.
32
 
33
  The repository includes the transformer, text encoder, tokenizer, VAE, and
34
- scheduler. It now also includes [`pipeline.py`](./pipeline.py), a custom
35
  image-to-video pipeline exposing all six inference configurations evaluated in
36
  the VBVR-Pro paper.
37
 
38
- ## Inference samplers
39
 
40
  The sampler is selected per call; the model weights do not change.
41
 
@@ -53,7 +109,7 @@ matched settings below. The model was trained with Flow-CPS coefficient 0.7.
53
  Reported scores are evaluation results, not guarantees for other prompts or
54
  runtime configurations.
55
 
56
- ## Recommended evaluation settings
57
 
58
  - Resolution: 512 × 512
59
  - Frames: 81
@@ -61,7 +117,9 @@ runtime configurations.
61
  - Inference steps: 30
62
  - Guidance scale: 1.0
63
 
64
- ## Usage with all six samplers
 
 
65
 
66
  Use Diffusers 0.37.1 or newer. Because this loads Python code from the model
67
  repository, review `pipeline.py`, pass `trust_remote_code=True`, and pin a
@@ -113,7 +171,7 @@ default, the fresh Flow-CPS transition noise. Pass a separate
113
  Loading the complete pipeline requires substantial CPU and accelerator
114
  memory. CPU offloading is recommended on smaller GPUs.
115
 
116
- ## Standard Diffusers compatibility
117
 
118
  The bundled scheduler remains UniPC and `model_index.json` is unchanged. Users
119
  who only need the standard deterministic path can load the checkpoint without
@@ -153,13 +211,15 @@ does not accept the first-frame `image` argument in Diffusers 0.37.1.
153
  formal score provenance. Exact output bytes can vary with PyTorch,
154
  Diffusers, attention backend, dtype, and device.
155
 
156
- ## Training summary
 
 
157
 
158
  The model was optimized on VBVR-Pro image-to-video tasks using Flow-CPS
159
  rollouts and deterministic task-specific rule rewards. Training and evaluation
160
  targeted 512 × 512 videos with 81 frames.
161
 
162
- ## Training resources
163
 
164
  - Release training code: [`pufanyi/vbvr-rl`](https://github.com/pufanyi/vbvr-rl)
165
  - Training dataset: [`Video-Reason/VBVR-Pro-RL`](https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL), revision `ca0aaffea93b07d269c6fe2fbfe533f1fdab9aa1`
@@ -173,9 +233,21 @@ targeted 512 × 512 videos with 81 frames.
173
  model and its training data.
174
  - Do not use generated outputs as the sole basis for high-stakes decisions.
175
 
176
- ## License and attribution
177
 
178
  The model is released under Apache License 2.0. See `LICENSE`. Please also
179
  follow the terms and attribution guidance of the upstream Wan2.2 model.
180
 
181
- Citation information will be added with the paper release.
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  - vbvr-pro
22
  ---
23
 
24
+ # VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
25
+
26
+ <div align="center">
27
+
28
+ <p align="center">
29
+ <a href="https://video-reason.com/?v=pro" target="_blank">
30
+ <img alt="Project Page" src="https://img.shields.io/badge/Project%20-%20Homepage-4285F4" height="20" />
31
+ </a>
32
+ <a href="https://huggingface.co/papers/2608.26105" target="_blank">
33
+ <img alt="arXiv" src="https://img.shields.io/badge/arXiv-VBVR_Pro-red?logo=arxiv" height="20" />
34
+ </a>
35
+ <a href="https://github.com/Video-Reason/VBVR-Pro" target="_blank">
36
+ <img alt="Training and Inference" src="https://img.shields.io/badge/Training_&_Inference-VBVR_Pro-100000?style=flat-square&logo=github&logoColor=white" height="20" />
37
+ </a>
38
+ <a href="https://github.com/Video-Reason/VBVR-Pro-Bench" target="_blank">
39
+ <img alt="Evaluation Code" src="https://img.shields.io/badge/Evaluation_code-VBVR_Pro_Bench-100000?style=flat-square&logo=github&logoColor=white" height="20" />
40
+ </a>
41
+ <a href="https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL" target="_blank">
42
+ <img alt="RL Dataset" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_RL-Dataset-ffc107?color=ffc107&logoColor=white" height="20" />
43
+ </a>
44
+ <a href="https://huggingface.co/datasets/Video-Reason/VBVR-Pro-Bench/tree/main" target="_blank">
45
+ <img alt="Bench Data" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_Bench-Data-ffc107?color=ffc107&logoColor=white" height="20" />
46
+ </a>
47
+ <a href="https://video-reason.com/pro/bench/#leaderboard" target="_blank">
48
+ <img alt="Leaderboard" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Pro_Bench-Leaderboard-ffc107?color=ffc107&logoColor=white" height="20" />
49
+ </a>
50
+ </p>
51
+
52
+ </div>
53
+
54
+ ## Overview
55
+
56
+ Native visual reasoning, i.e., reasoning through visual generation, has recently emerged as a promising direction for studying visual intelligence beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce **VBVR-Pro**, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. **1) Task scaling.** VBVR-Pro turns visual reasoning into a controlled task space of *300* procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across *six* held-out visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. Further analysis validates that these gains reflect visual reasoning rather than instruction-pattern fitting. **2) Verifiable rewards.** VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent *VLM-as-a-judge* paradigm. In contrast, the proposed scorers are grounded on verifiable task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. **3) Mechanism study.** VBVR-Pro enables controlled modality studies across more than *30* image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative by externalizing intermediate visual states. Critically, ablations and probing confirm the presence of vision-native trajectories, that are a more crucial substrate than explicit linguistic chains of thought for visual reasoning. We release all data, models, scorers, and code to facilitate future research.
57
+
58
+ The models are presented in the paper [VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning](https://huggingface.co/papers/2608.26105).
59
+
60
+ ## Models Zoo
61
+
62
+ <table border="1" cellspacing="0" cellpadding="4" style="border-collapse: collapse; width: 100%;">
63
+ <thead>
64
+ <tr>
65
+ <th>Model</th>
66
+ <th>Base Architecture</th>
67
+ <th>Other Remarks</th>
68
+ </tr>
69
+ </thead>
70
+ <tbody>
71
+ <tr style="border-top: 4px solid #6b7280; background-color: #e5e7eb;"><th colspan="3" align="left">Video Generation Models</th></tr>
72
+ <tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B">VBVR-Pro-Wan2.2-TI2V-5B</a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, supervised fine-tuning</td></tr>
73
+ <tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVR"><strong>VBVR-Pro-Wan2.2-TI2V-5B-RLVR</strong></a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, RL with verifiable rewards</td></tr>
74
+ <tr><td><a href="https://huggingface.co/Video-Reason/VBVR-Pro-Wan2.2-TI2V-5B-RLVLM-Qwen3.6-27B-Reward">VBVR-Pro-Wan2.2-TI2V-5B-RLVLM-Qwen3.6-27B-Reward</a></td><td>Wan2.2-TI2V-5B</td><td>Complete model, RL with Qwen3.6-27B VLM rewards</td></tr>
75
+ </tbody>
76
+ </table>
77
+
78
+ ## Release Information
79
+
80
+ ### VBVR-Pro-Wan2.2-TI2V-5B-RLVR
81
 
82
  This repository contains a complete Diffusers checkpoint for the VBVR-Pro
83
  Wan2.2 TI2V-5B model optimized with reinforcement learning with verifiable
 
87
  reasoning.
88
 
89
  The repository includes the transformer, text encoder, tokenizer, VAE, and
90
+ scheduler. It also includes [`pipeline.py`](./pipeline.py), a custom
91
  image-to-video pipeline exposing all six inference configurations evaluated in
92
  the VBVR-Pro paper.
93
 
94
+ ## VBVR-Pro Benchmark Results
95
 
96
  The sampler is selected per call; the model weights do not change.
97
 
 
109
  Reported scores are evaluation results, not guarantees for other prompts or
110
  runtime configurations.
111
 
112
+ ### Recommended evaluation settings
113
 
114
  - Resolution: 512 × 512
115
  - Frames: 81
 
117
  - Inference steps: 30
118
  - Guidance scale: 1.0
119
 
120
+ ## Quick Start
121
+
122
+ ### Custom sampler pipeline
123
 
124
  Use Diffusers 0.37.1 or newer. Because this loads Python code from the model
125
  repository, review `pipeline.py`, pass `trust_remote_code=True`, and pin a
 
171
  Loading the complete pipeline requires substantial CPU and accelerator
172
  memory. CPU offloading is recommended on smaller GPUs.
173
 
174
+ ### Standard Diffusers pipeline
175
 
176
  The bundled scheduler remains UniPC and `model_index.json` is unchanged. Users
177
  who only need the standard deterministic path can load the checkpoint without
 
211
  formal score provenance. Exact output bytes can vary with PyTorch,
212
  Diffusers, attention backend, dtype, and device.
213
 
214
+ ## Training Details
215
+
216
+ ### Summary
217
 
218
  The model was optimized on VBVR-Pro image-to-video tasks using Flow-CPS
219
  rollouts and deterministic task-specific rule rewards. Training and evaluation
220
  targeted 512 × 512 videos with 81 frames.
221
 
222
+ ### Resources
223
 
224
  - Release training code: [`pufanyi/vbvr-rl`](https://github.com/pufanyi/vbvr-rl)
225
  - Training dataset: [`Video-Reason/VBVR-Pro-RL`](https://huggingface.co/datasets/Video-Reason/VBVR-Pro-RL), revision `ca0aaffea93b07d269c6fe2fbfe533f1fdab9aa1`
 
233
  model and its training data.
234
  - Do not use generated outputs as the sole basis for high-stakes decisions.
235
 
236
+ ## License
237
 
238
  The model is released under Apache License 2.0. See `LICENSE`. Please also
239
  follow the terms and attribution guidance of the upstream Wan2.2 model.
240
 
241
+ ## Citation
242
+
243
+ ```bibtex
244
+ @misc{xu2026vbvrproscalableverifiablesuite,
245
+ title={VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning},
246
+ author={Junxiang Xu and Ruisi Wang and Fanyi Pu and Maijunxian Wang and Ran Ji and Tongxi Zhou and Chenyang Gu and Jing Zuo and Hongcan Xiao and Yimeng Geng and Wanqi Yin and Wei Chen and Oscar Qian and Zhengan Yan and Ziqi Huang and Haiwen Diao and Liang Pan and Bo Li and Xiangyu Fan and Dezhi Luo and Fengyuan Yu and Zehong Zhao and Qingying Gao and Tinghui Zhu and Yilan Zhang and Jingqi Tong and Pinyuan Feng and Zhengze Jiang and Letian Wang and Ziyu Guo and Renrui Zhang and Jieneng Chen and Sonia Joseph and Constantin Venhoff and Saman Motamed and Mengyue Yang and Chandra Sripada and Alan Yuille and Philip Torr and Lvmin Zhang and Vikash Kumar and Daniel Khashabi and Nikolaus Kriegeskorte and Raphaël Millière and Vincent C. Müller and Anyi Rao and Quan Wang and Ziwei Liu and Dahua Lin and Lei Yang and Hokin Deng and Zhongang Cai},
247
+ year={2026},
248
+ eprint={2608.26105},
249
+ archivePrefix={arXiv},
250
+ primaryClass={cs.CV},
251
+ url={https://arxiv.org/abs/2608.26105},
252
+ }
253
+ ```