File size: 1,106 Bytes
cde3acb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | bernini-r-mlx
Apache MLX port of ByteDance Bernini-R (the Bernini Renderer).
This work is licensed under the Apache License, Version 2.0.
It is derived from and depends on the following Apache-2.0 works; their notices
and attributions are retained here:
- ByteDance/Bernini-R — the Bernini Renderer (weights + reference inference code).
https://github.com/bytedance/Bernini · https://huggingface.co/ByteDance/Bernini-R-Diffusers
Paper: "Bernini: Latent Semantic Planning for Video Diffusion" (arXiv:2605.22344).
- Wan-AI/Wan2.2-T2V-A14B — the base DiT, 16-channel causal VAE, and UMT5 text encoder
that Bernini-R fine-tunes / reuses. https://github.com/Wan-Video/Wan2.2
- Qwen2.5-VL-7B-Instruct — the Bernini *planner* (NOT used here; not released as weights).
- mlx-video (Blaizzy/mlx-video) — the MLX Wan2.2 backbone reused by this port.
Scope note: only the Bernini *Renderer* is open-sourced upstream. The MLLM semantic
planner (the paper's "latent semantic planning") is not released, so this port runs with
UMT5 text conditioning only; the planner-feature channel is absent.
|