xocialize's picture
Add Bernini-R-1.3B MLX (single-expert Wan2.1-1.3B renderer)
131d52a verified
bernini-r-mlx (1.3B tier)
Apache MLX port of ByteDance Bernini-R-1.3B (the Bernini Renderer, small tier).
This work is licensed under the Apache License, Version 2.0.
It is derived from and depends on the following Apache-2.0 works; their notices
and attributions are retained here:
- ByteDance/Bernini-R-1.3B — the Bernini Renderer, 1.3B tier (weights + reference
inference code).
https://github.com/bytedance/Bernini · https://huggingface.co/ByteDance/Bernini-R-1.3B-Diffusers
Paper: "Bernini: Latent Semantic Planning for Video Diffusion" (arXiv:2605.22344).
- Wan-AI/Wan2.1-T2V-1.3B — the base DiT, 16-channel causal VAE, and UMT5 text encoder
that Bernini-R-1.3B fine-tunes / reuses. https://github.com/Wan-Video/Wan2.1
- Qwen2.5-VL-7B-Instruct — the Bernini *planner* (NOT used here; not released as weights).
- mlx-video (Blaizzy/mlx-video) — the MLX Wan backbone reused by this port.
Scope note: only the Bernini *Renderer* is open-sourced upstream. The MLLM semantic
planner (the paper's "latent semantic planning") is not released, so this port runs with
UMT5 text conditioning only; the planner-feature channel is absent.