Image-to-Video
Diffusers
Safetensors
wruisi commited on
Commit
d98d411
·
verified ·
1 Parent(s): 3041732

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -30
README.md CHANGED
@@ -33,6 +33,9 @@ pipeline_tag: image-to-video
33
  <img alt="Leaderboard" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Bench-Leaderboard-ffc107?color=ffc107&logoColor=white" height="20" />
34
  </a>
35
 
 
 
 
36
 
37
  ## Overview
38
  Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can naturally capture,
@@ -49,6 +52,25 @@ to unseen reasoning tasks. **Together, VBVR lays a foundation for the next stage
49
 
50
  The model was presented in the paper [A Very Big Video Reasoning Suite](https://huggingface.co/papers/2602.20159).
51
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
  <table>
53
  <tr>
54
  <th>Model</th>
@@ -104,6 +126,11 @@ The model was presented in the paper [A Very Big Video Reasoning Suite](https://
104
  <tr style="background:#F2F0EF;font-weight:700;text-align:center;">
105
  <td colspan="14"><em>Proprietary Models</em></td>
106
  </tr>
 
 
 
 
 
107
  <tr>
108
  <td>Runway Gen-4 Turbo</td>
109
  <td>0.403</td><td>0.392</td><td>0.396</td><td>0.409</td><td>0.429</td><td>0.341</td><td>0.363</td>
@@ -111,50 +138,50 @@ The model was presented in the paper [A Very Big Video Reasoning Suite](https://
111
  </tr>
112
  <tr>
113
  <td><strong>Sora 2</strong></td>
114
- <td><strong>0.546</strong></td><td><strong>0.569</strong></td><td><u>0.602</u></td>
115
- <td><u>0.477</u></td><td><strong>0.581</strong></td><td><strong>0.572</strong></td>
116
- <td><strong>0.597</strong></td><td><strong>0.523</strong></td>
117
  <td><u>0.546</u></td><td><strong>0.472</strong></td><td><strong>0.525</strong></td>
118
- <td><strong>0.462</strong></td><td><strong>0.546</strong></td>
119
  </tr>
120
  <tr>
121
  <td>Kling 2.6</td>
122
- <td>0.369</td><td>0.408</td><td>0.465</td><td>0.323</td><td>0.375</td><td>0.347</td><td><u>0.519</u></td>
123
  <td>0.330</td><td>0.528</td><td>0.135</td><td>0.272</td><td>0.356</td><td>0.359</td>
124
  </tr>
125
  <tr>
126
- <td><u>Veo 3.1</u></td>
127
- <td><u>0.480</u></td><td><u>0.531</u></td><td><strong>0.611</strong></td>
128
- <td><strong>0.503</strong></td><td><u>0.520</u></td><td><u>0.444</u></td>
129
- <td>0.510</td><td><u>0.429</u></td>
130
- <td><strong>0.577</strong></td><td>0.277</td><td><u>0.420</u></td>
131
- <td><u>0.441</u></td><td><u>0.404</u></td>
132
  </tr>
133
  <tr style="background:#F2F0EF;font-weight:700;text-align:center;">
134
  <td colspan="14"><em>Data Scaling Strong Baseline</em></td>
135
  </tr>
 
 
 
 
 
 
 
 
 
 
136
  <tr>
137
  <td><strong>VBVR-Wan2.2</strong></td>
138
  <td><strong>0.685</strong></td><td><strong>0.760</strong></td><td><strong>0.724</strong></td>
139
  <td><strong>0.750</strong></td><td><strong>0.782</strong></td><td><strong>0.745</strong></td>
140
  <td><strong>0.833</strong></td><td><strong>0.610</strong></td>
141
- <td><strong>0.768</strong></td><td><strong>0.572</strong></td><td><strong>0.547</strong></td>
142
  <td><strong>0.618</strong></td><td><strong>0.615</strong></td>
143
  </tr>
144
  </tbody>
145
  </table>
146
 
147
- ## Release Information
148
- VBVR-Wan2.2 is trained from Wan2.2-I2V-A14B without architectural modifications, as the goal of VBVR-Wan2.2 is to *investigate data scaling behavior* and provide a *strong baseline model* for the video reasoning research community. Leveraging the VBVR-Dataset, which constitutes one of the largest video reasoning datasets to date, VBVR-Wan2.2 achieved highest score on VBVR-Bench.
149
-
150
- In this release, we present
151
- [**VBVR-Wan2.2**](https://huggingface.co/Video-Reason/VBVR-Wan2.2),
152
- [**VBVR-Dataset**](https://huggingface.co/datasets/Video-Reason/VBVR-Dataset),
153
- [**VBVR-Bench-Data**](https://huggingface.co/datasets/Video-Reason/VBVR-Bench-Data) and
154
- [**VBVR-Bench-Leaderboard**](https://huggingface.co/spaces/Video-Reason/VBVR-Bench-Leaderboard).
155
-
156
-
157
- ## 🛠️ QuickStart
158
 
159
  ### Installation
160
 
@@ -176,7 +203,7 @@ python example.py \
176
  --model_path ./VBVR-Wan2.2
177
  ```
178
 
179
- ## 🖊️ Citation
180
 
181
  ```bibtex
182
  @article{vbvr2026,
@@ -201,9 +228,3 @@ python example.py \
201
  url = {https://arxiv.org/abs/2602.20159}
202
  }
203
  ```
204
-
205
- ## License
206
-
207
- Apache License
208
- Version 2.0, January 2004
209
- http://www.apache.org/licenses/
 
33
  <img alt="Leaderboard" src="https://img.shields.io/badge/%F0%9F%A4%97%20_VBVR_Bench-Leaderboard-ffc107?color=ffc107&logoColor=white" height="20" />
34
  </a>
35
 
36
+ 🔥Please check out our newly released [**VBVR-Wan2.1**](https://huggingface.co/Video-Reason/VBVR-Wan2.1) (Diffusers format),
37
+ [**VBVR-Wan2.1-diffsynth**](https://huggingface.co/Video-Reason/VBVR-Wan2.1-diffsynth) (DiffSynth LoRA format), and
38
+ [**VBVR-LTX2.3-diffsynth**](https://huggingface.co/Video-Reason/VBVR-LTX2.3-diffsynth) (DiffSynth LoRA format; Diffusers does not yet support LTX-Video-2.3, so only the DiffSynth LoRA format is released for this model).
39
 
40
  ## Overview
41
  Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can naturally capture,
 
52
 
53
  The model was presented in the paper [A Very Big Video Reasoning Suite](https://huggingface.co/papers/2602.20159).
54
 
55
+ ## Models Zoo
56
+
57
+ | Model | Base Architecture | Other Remarks |
58
+ |-------|-------------------|---------------|
59
+ | [VBVR-Wan2.1](https://huggingface.co/Video-Reason/VBVR-Wan2.1) | Wan2.1-I2V-14B-720P | Diffusers format |
60
+ | [**VBVR-Wan2.2**](https://huggingface.co/Video-Reason/VBVR-Wan2.2) | Wan2.2-I2V-A14B | Diffusers format |
61
+ | [VBVR-Wan2.1-diffsynth](https://huggingface.co/Video-Reason/VBVR-Wan2.1-diffsynth) | Wan2.1-I2V-14B-720P | DiffSynth LoRA format |
62
+ | [VBVR-Wan2.2-diffsynth](https://huggingface.co/Video-Reason/VBVR-Wan2.2-diffsynth) | Wan2.2-I2V-A14B | DiffSynth LoRA format |
63
+ | [VBVR-LTX2.3-diffsynth](https://huggingface.co/Video-Reason/VBVR-LTX2.3-diffsynth) | LTX-Video-2.3 | DiffSynth LoRA format |
64
+
65
+ ## Release Information
66
+ VBVR-Wan2.2 is trained from Wan2.2-I2V-A14B without architectural modifications, as the goal of VBVR-Wan2.2 is to *investigate data scaling behavior* and provide a *strong baseline model* for the video reasoning research community. Leveraging the VBVR-Dataset, which constitutes one of the largest video reasoning datasets to date, VBVR-Wan2.2 achieved highest score on VBVR-Bench.
67
+
68
+ In this release, we present
69
+ [**VBVR-Wan2.2**](https://huggingface.co/Video-Reason/VBVR-Wan2.2),
70
+ [**VBVR-Dataset**](https://huggingface.co/datasets/Video-Reason/VBVR-Dataset),
71
+ [**VBVR-Bench-Data**](https://huggingface.co/datasets/Video-Reason/VBVR-Bench-Data) and
72
+ [**VBVR-Bench-Leaderboard**](https://huggingface.co/spaces/Video-Reason/VBVR-Bench-Leaderboard).
73
+
74
  <table>
75
  <tr>
76
  <th>Model</th>
 
126
  <tr style="background:#F2F0EF;font-weight:700;text-align:center;">
127
  <td colspan="14"><em>Proprietary Models</em></td>
128
  </tr>
129
+ <tr>
130
+ <td><u>Seedance 2.0</u></td>
131
+ <td><u>0.544</u></td><td><strong>0.570</strong></td><td>0.593</td><td><u>0.498</u></td><td><strong>0.618</strong></td><td><u>0.514</u></td><td><strong>0.602</strong></td>
132
+ <td><u>0.517</u></td><td><strong>0.643</strong></td><td>0.398</td><td><u>0.492</u></td><td>0.427</td><td><strong>0.556</strong></td>
133
+ </tr>
134
  <tr>
135
  <td>Runway Gen-4 Turbo</td>
136
  <td>0.403</td><td>0.392</td><td>0.396</td><td>0.409</td><td>0.429</td><td>0.341</td><td>0.363</td>
 
138
  </tr>
139
  <tr>
140
  <td><strong>Sora 2</strong></td>
141
+ <td><strong>0.546</strong></td><td><u>0.569</u></td><td><u>0.602</u></td>
142
+ <td>0.477</td><td><u>0.581</u></td><td><strong>0.572</strong></td>
143
+ <td><u>0.597</u></td><td><strong>0.523</strong></td>
144
  <td><u>0.546</u></td><td><strong>0.472</strong></td><td><strong>0.525</strong></td>
145
+ <td><strong>0.462</strong></td><td><u>0.546</u></td>
146
  </tr>
147
  <tr>
148
  <td>Kling 2.6</td>
149
+ <td>0.369</td><td>0.408</td><td>0.465</td><td>0.323</td><td>0.375</td><td>0.347</td><td>0.519</td>
150
  <td>0.330</td><td>0.528</td><td>0.135</td><td>0.272</td><td>0.356</td><td>0.359</td>
151
  </tr>
152
  <tr>
153
+ <td>Veo 3.1</td>
154
+ <td>0.480</td><td>0.531</td><td><strong>0.611</strong></td>
155
+ <td><strong>0.503</strong></td><td>0.520</td><td>0.444</td>
156
+ <td>0.510</td><td>0.429</td>
157
+ <td><u>0.577</u></td><td>0.277</td><td>0.420</td>
158
+ <td><u>0.441</u></td><td>0.404</td>
159
  </tr>
160
  <tr style="background:#F2F0EF;font-weight:700;text-align:center;">
161
  <td colspan="14"><em>Data Scaling Strong Baseline</em></td>
162
  </tr>
163
+ <tr>
164
+ <td><strong>VBVR-LTX2.3</strong></td>
165
+ <td>0.516</td><td>0.580</td><td>0.608</td><td>0.631</td><td>0.529</td><td>0.454</td><td>0.680</td>
166
+ <td>0.453</td><td>0.608</td><td>0.577</td><td><u>0.409</u></td><td>0.414</td><td><u>0.388</u></td>
167
+ </tr>
168
+ <tr>
169
+ <td><strong>VBVR-Wan2.1</strong></td>
170
+ <td><u>0.592</u></td><td><u>0.724</u></td><td><u>0.705</u></td><td><u>0.710</u></td><td><u>0.727</u></td><td><u>0.719</u></td><td><u>0.784</u></td>
171
+ <td><u>0.461</u></td><td><u>0.674</u></td><td><strong>0.592</strong></td><td>0.387</td><td><u>0.461</u></td><td>0.387</td>
172
+ </tr>
173
  <tr>
174
  <td><strong>VBVR-Wan2.2</strong></td>
175
  <td><strong>0.685</strong></td><td><strong>0.760</strong></td><td><strong>0.724</strong></td>
176
  <td><strong>0.750</strong></td><td><strong>0.782</strong></td><td><strong>0.745</strong></td>
177
  <td><strong>0.833</strong></td><td><strong>0.610</strong></td>
178
+ <td><strong>0.768</strong></td><td><u>0.572</u></td><td><strong>0.547</strong></td>
179
  <td><strong>0.618</strong></td><td><strong>0.615</strong></td>
180
  </tr>
181
  </tbody>
182
  </table>
183
 
184
+ ## QuickStart
 
 
 
 
 
 
 
 
 
 
185
 
186
  ### Installation
187
 
 
203
  --model_path ./VBVR-Wan2.2
204
  ```
205
 
206
+ ## Citation
207
 
208
  ```bibtex
209
  @article{vbvr2026,
 
228
  url = {https://arxiv.org/abs/2602.20159}
229
  }
230
  ```