| --- |
| license: apache-2.0 |
| base_model: Wan-AI/Wan2.2-T2V-A14B |
| pipeline_tag: text-to-video |
| library_name: diffusers |
| tags: |
| - comfyui |
| - bernini-r |
| - wan2.2 |
| - text-to-video |
| - video-editing |
| - reference-to-video |
| - fp8 |
| --- |
| |
| # Bernini-R fp8 (e4m3) — for ComfyUI-BerniniR |
|
|
| fp8 (`float8_e4m3fn`, **weight-only**) build of **[ByteDance/Bernini-R](https://huggingface.co/ByteDance/Bernini-R)** |
| (which is Wan2.2-T2V-A14B inside), **self-contained** (2 transformers + VAE + UMT5 + tokenizer + |
| scheduler), packaged for the **[ComfyUI-BerniniR](https://github.com/neuregex/ComfyUI-BerniniR)** |
| custom node. Runs the **full pipeline in 24 GB**. |
|
|
| The Linear weights are stored in `float8_e4m3fn` and upcast to bf16 on every forward; |
| norms / embeddings / time-/text-embedders / patch-embed stay in bf16/fp32. These weights are |
| **bit-identical** to the node's on-the-fly fp8 quantization — validated end-to-end on an i2i edit: |
| same seed, same GPU → **0 pixel difference**. Loading this pre-quantized bundle is also faster |
| (no bf16 → fp8 cast at load). |
|
|
| ## VRAM (measured: `torch.cuda.max_memory_allocated`, NVIDIA A10 24 GB, fp8 + sequential offload) |
|
|
| | Task | Frames / resolution | Peak VRAM | Fits 24 GB | |
| |---|---|---|---| |
| | i2i / t2i (image edit / image) | 1 frame, 848×848 | **~16.7 GB** | ✅ | |
| | t2v / v2v / rv2v (video / video edit) | **81 frames** (full length), 480p | **~18.8 GB** | ✅ | |
|
|
| The UMT5 text encoder is freed before the experts load, and offload keeps a single ~14 GB expert |
| resident — that is what makes full-length 480p video fit in 24 GB. |
|
|
| ## Tasks |
|
|
| `t2v` · `t2i` · `i2i` (image edit) · `v2v` (video edit) · `rv2v` (video edit + reference) · |
| `r2v` (reference-to-video). Edits preserve the source content/motion via Bernini's source-id RoPE |
| (validated qualitatively). |
|
|
| ## Usage |
|
|
| Install the **[ComfyUI-BerniniR](https://github.com/neuregex/ComfyUI-BerniniR)** node, then in |
| `BerniniR · Load Model`: |
|
|
| - set **source = `neuregex/Bernini-R-fp8 (auto)`** with `auto_download = True` — downloads ~40 GB to |
| `download_dir` on first run (with a free-space check and progress bar), or |
| - `hf download neuregex/Bernini-R-fp8 --local-dir models/bernini/Bernini-R-fp8` and use `source = local`. |
|
|
| For the full **bf16** weights instead, point the node at `ByteDance/Bernini-R-Diffusers` |
| (`source = ... (full bf16)`), which needs more VRAM (A100-class) or on-the-fly fp8. |
|
|
| ## Credits & license |
|
|
| - Algorithm & model: **Bernini: Latent Semantic Planning for Video Diffusion**, ByteDance |
| ([arXiv:2605.22344](https://arxiv.org/abs/2605.22344) · [code](https://github.com/bytedance/Bernini)) — Apache-2.0. |
| - Base: [Wan2.2-T2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B). |
| - fp8 build by **neuregex**. **Apache-2.0**. |
|
|
