Spaces:
Running on Zero
Running on Zero
| title: Bernini Diffusers v2 | |
| emoji: 🗿 | |
| colorFrom: yellow | |
| colorTo: purple | |
| sdk: gradio | |
| sdk_version: 6.15.0 | |
| app_file: app.py | |
| pinned: false | |
| license: apache-2.0 | |
| short_description: Reference-to-video with ByteDance Bernini-Diffusers-v2 | |
| python_version: "3.12" | |
| startup_duration_timeout: 2h | |
| models: | |
| - ByteDance/Bernini-Diffusers-v2 | |
| # Bernini-Diffusers-v2 — reference-to-video | |
| Give it a handful of **reference images** (a subject, an outfit, a prop, a scene…) and a prompt | |
| that points at them as `image0`, `image1`, … Bernini's Qwen2.5-VL planner reads the references | |
| together with the instruction and *plans* a target visual embedding with a flow-matching head; the | |
| Wan2.2-A14B MoE renderer (two 14 B DiTs, high-noise + low-noise) turns that plan into a video. | |
| - Model: [`ByteDance/Bernini-Diffusers-v2`](https://huggingface.co/ByteDance/Bernini-Diffusers-v2) | |
| - Code: [`bytedance/Bernini`](https://github.com/bytedance/Bernini) | |
| ## What this Space runs | |
| The `r2v` (reference-to-video) task, matching the authors' `scripts/bernini_v2/run_r2v.sh` | |
| one-for-one: `guidance_mode=vae_txt_vit_wapg`, `omega_txt=4.5`, `omega_tgt=1.5`, `omega_img=3.0`, | |
| `omega_vid=1.0`, `omega_scale=0.75`, `planning_step=50`, `vit_denoising_step=1`, `vit_txt_cfg=1.2`, | |
| `vit_img_cfg=1.0`, `flow_shift=5.0`, `max_image_size=842`, 16 fps, and the same system / negative | |
| prompt. | |
| The only deviation is the default clip length and step count (33 frames / 16 steps instead of | |
| 81 / 40), so a generation fits inside a single ZeroGPU slot — both are sliders under | |
| **Advanced settings**. At the defaults a video takes about 4 minutes. | |
| The released checkpoint is fp32 (~180 GB); it is loaded in bf16, which is the dtype the reference | |
| pipeline computes in anyway. | |
| ## Credits | |
| The `bernini/` package and the `veomni/` subset shipped alongside `app.py` are vendored from | |
| [`bytedance/Bernini`](https://github.com/bytedance/Bernini) and | |
| [`ByteDance-Seed/VeOmni`](https://github.com/ByteDance-Seed/VeOmni) (v0.1.11), both Apache-2.0, | |
| because both declare `requires-python` ranges that exclude this runtime. | |
| The example reference images in `examples/` are the authors' own r2v test case assets from | |
| `bytedance/Bernini` (Apache-2.0). | |