Bernini V2 ComfyUI weights

Native ComfyUI packages for ByteDance/Bernini-Diffusers-v2. They are used by T8mars/comfyui-bernini-v2-T8 and do not require a Diffusers pipeline at runtime. Native ComfyUI Core support is under review in Comfy-Org/ComfyUI#16019. The obsolete sharded proposal in #16001 is closed. The current custom-node release is 0.3.3.

Bernini v2 first plans the requested scene and motion with Qwen2.5-VL, then renders the result with two Wan2.2 experts. It supports text-to-image, image-to-image, text-to-video, video-to-video, reference-to-video, and reference-guided video editing.

Available models

The native runtime uses ComfyUI's standard folders. Every listed component is one file; there is no Diffusers directory, shard index, or runtime manifest.

Profile Files Storage Size Recommended use
*_int8.safetensors 4 ComfyUI int8_tensorwise + ConvRot, BF16 fallback 45.63 GiB Recommended for 24 GB GPUs
*_bf16.safetensors 4 True BF16 83.04 GiB Reference-quality and conversion source
Bernini-v2-GGUF-Q4_K_S/ 2 renderers ComfyUI-GGUF Q4_K_S/Q5_K/F32 16.31 GiB Experimental low-storage renderer lane
vae/wan_2.1_vae.safetensors 1 BF16 Wan 2.1 VAE 242.06 MiB Required companion file

Published native-file checksums:

Path Bytes SHA-256
text_encoders/bernini_v2_planner_int8.safetensors 11,494,536,518 afa2c89e715d535e18ab9d7042f2ae1caba4e453c097358c61b569d2f11481b0
text_encoders/umt5_xxl_bernini_v2_int8.safetensors 8,840,172,065 a9e268058021cab3e2513b13d4f4be0c21ff86f46c814f76728717e3937f9b1b
diffusion_models/bernini_v2_high_noise_int8.safetensors 14,331,566,920 1f8f44ba56181cd826ec13b46e804ec075b842135e6c31b6d3bb7a0438ec34da
diffusion_models/bernini_v2_low_noise_int8.safetensors 14,331,566,920 a443377b17f6eae76450554b63fc2c1e883c1022826b9994e970813f40267b6a
text_encoders/bernini_v2_planner_bf16.safetensors 18,547,047,134 686437fda8400ca1ee69f8436c2d546334f781360a8bc1416467845436877f3f
text_encoders/umt5_xxl_bernini_v2_bf16.safetensors 13,466,697,617 895e28d30d7d54d178bb65c46252bf6c24d229f3db7f1065e5a76219c62f220b
diffusion_models/bernini_v2_high_noise_bf16.safetensors 28,577,096,840 6bf8eeae9688e89dd90eb146aabbbc5f2f023d9ffa60c19ebf47b5e288b446cd
diffusion_models/bernini_v2_low_noise_bf16.safetensors 28,577,096,840 9da6d2fe917a4c7d39ebfc8cb2d3398fcfd672bcad79a9057749d8233f74b052

The Balanced INT8 package quantizes 1,300 linear layers across the planner, T5, and both Wan experts. Every converted layer was reconstructed and checked; no layer required a quality fallback at cosine 0.99 and relative-error 2% thresholds.

Both native profiles come from immutable upstream revision 399cf6a18a4c523b367b2b1ac25a2a61009e7df3. The Planner embeds the exact Qwen config and tokenizer; UMT5 embeds the released SentencePiece model. The two Wan experts each contain all 40 blocks and have matching normalized key contracts.

GGUF and NVFP4 are external renderer-only paths and do not replace the native planner package. The published GGUF pair has matching 1,095-tensor high/low contracts, all 40 Wan blocks, and a repaired F32 5-D patch embedding. Each file is 8,756,353,664 bytes. Balanced INT8 remains the recommended quality profile; GGUF Q4_K_S trades some facial and limb detail for lower renderer storage.

Installation

Install Bernini v2 (Native) from ComfyUI-Manager, or clone the node repository into ComfyUI/custom_nodes.

Download the recommended standalone INT8 files directly into the standard ComfyUI model folders:

hf download t8star/Bernini-V2-Comfy \
  --include "text_encoders/*_int8.safetensors" "diffusion_models/*_int8.safetensors" "vae/wan_2.1_vae.safetensors" \
  --local-dir /path/to/ComfyUI/models

For BF16 instead:

hf download t8star/Bernini-V2-Comfy \
  --include "text_encoders/*_bf16.safetensors" "diffusion_models/*_bf16.safetensors" "vae/wan_2.1_vae.safetensors" \
  --local-dir /path/to/ComfyUI/models

For the experimental GGUF renderer pair, first install ComfyUI-GGUF, then download the files to its diffusion-model directory:

hf download t8star/Bernini-V2-Comfy \
  --include "Bernini-v2-GGUF-Q4_K_S/*" \
  --local-dir /path/to/ComfyUI/models/diffusion_models
  • High SHA-256: b72df0b32d305b7acade0a7245edde37716f7202f5fbc99fda43aedf5d1ebc87
  • Low SHA-256: d396d3dcf935deb5bb1d8e6c6735e644adfa23d277efe0c2865bba03d6b7c92b
  • High/low contract SHA-256: e779b82a06707b08f85d03e812293e4a14a96eccf00f189f239443e366351b76

The same repository includes the verified standard Wan 2.1 VAE. Download it directly into the ComfyUI model root:

hf download t8star/Bernini-V2-Comfy \
  --include "vae/wan_2.1_vae.safetensors" \
  --local-dir /path/to/ComfyUI/models

The resulting path is:

ComfyUI/models/vae/wan_2.1_vae.safetensors

The node repository also includes a pinned downloader:

python tools/download_vae.py --output /path/to/ComfyUI/models/vae

Open one of the six workflows under the node repository's examples/workflows/ directory after the files are in place.

Validated runtime

The current ComfyUI Core candidate completed the official T2V preset at 640ร—368, 33 frames, and 16 fps: 50 MaskGIT planning steps, one VIT denoising step, 50 flow-UniPC renderer steps, and the released T2V guidance values. All 33 decoded frames are unique. Peak ComfyUI-visible VRAM was 23.255 GiB on the 24 GB test GPU.

The Balanced INT8 tensors passed a production-step 640ร—368, 33-frame T2V run on a 24 GB RTX 5090 Laptop GPU. ComfyUI-visible VRAM peaked at 16.51 GiB. Two consecutive uncached jobs in one server process produced identical decoded frames and returned memory to baseline. Reduced two-second, long-edge-640 T2V, V2V, R2V, and RV2V runs also passed.

The final standalone INT8 files additionally passed strict header/key/tokenizer validation, real construction of Planner, Core Wan UMT5, and both 14.288B Wan experts, plus a 640ร—368, 33-frame end-to-end 5/2/10-step format gate. It completed in 342.31 seconds with 33 unique frames and recognizable coherent fox motion. That reduced-step result validates packaging and execution, not production-preset detail quality. A 1/1/2-step result was intentionally rejected as a quality sample because it remained a blurred color mass.

The external NVFP4 renderer pair from rzgar/Bernini-v2-ComfyUI also passed a production-step 640ร—368, 33-frame T2V visual gate with the native Balanced-INT8 planner. All 33 frame hashes are unique and no quantization collapse is visible. The 1,518-second run used PyTorch 2.11/CUDA 12.8 eager operations because driver 576.28 cannot initialize CUDA 13, and another process occupied about 8.5 GiB of VRAM. It is quality evidence, not a valid optimized speed or isolated-memory comparison.

The GGUF Q4_K_S renderer pair passed the same 640ร—368, 33-frame production-step gate with seed 42 and 25/5/40 planner/VIT/renderer steps. All 33 decoded frames are unique, motion is coherent, and there is no block-noise or frozen-frame collapse. Compared with Balanced INT8, the face is softer and isolated frames show an elongated lifted paw or mild rear-leg/tail-root merging. This is a usable experimental low-storage lane, not a quality-parity claim. The run took 1,319.907 seconds on the older PyTorch 2.7/CUDA 12.8 compatibility path; its memory samples are not an isolated benchmark.

Detailed settings, hashes, and visual evidence are available in the quality report and low-memory guide.

License and attribution

The original Bernini v2 weights and code are released under Apache License 2.0. These dtype-converted and quantized packages remain under Apache-2.0. The GGUF conversion policy and 5-D repair workflow are adapted from the Apache-2.0 city96/ComfyUI-GGUF tooling; the runtime loader is not bundled. The Wan 2.1 VAE companion is an unchanged mirror of Comfy-Org's Apache-2.0 repackage at revision c4f60d30c55a624e35427060fdd217579a6c1d77; its SHA-256 is 2fc39d31359a4b0a64f55876d8ff7fa8d780956ae2cb13463b0223e15148976b.

Links

Downloads last month
-
GGUF
Model size
14B params
Architecture
wan
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for t8star/Bernini-V2-Comfy

Quantized
(1)
this model