cmf-animate / README.md
infosave's picture
video and its soundtrack from one file
e43f223 verified
|
Raw
History Blame Contribute Delete
1.78 kB

A newer version of the Gradio SDK is available: 6.24.0

Upgrade
metadata
title: MiniMax-H3 Turbo from one .cmf
emoji: 🎬
colorFrom: gray
colorTo: purple
sdk: gradio
app_file: app.py
pinned: false
license: apache-2.0
short_description: Video and its synchronized audio, from one 23.9 GB file
tags:
  - cortiq
  - cmf
models:
  - infosave/MiniMax-H3-Turbo-cmf

Video and its soundtrack, from one file

One prompt, one transformer, four steps β€” and out comes a clip and the stereo audio that goes with it, denoised together in one packed sequence on two different flow schedules.

Four files and a ComfyUI checkout β€” 124.4 GB β€” become one 23.9 GB .cmf: the 33 B DiT, its Qwen3-VL-32B prompt encoder, the ViT3D video decoder, the BigVGAN vocoder. The 4-step Turbo LoRA is merged in, so the file is the turbo model. The AVI and the WAV are written by the same 8 MB Rust binary β€” there is no ffmpeg anywhere in this pipeline, and the GIF previews here are assembled by pulling the JPEG frames straight out of the AVI.

The gallery was rendered on real hardware: 512Γ—288, 39 frames, 4 steps, 172 s on one RTX PRO 6000 and 346 s on 48 CPU cores. This Space has no GPU, so rendering here is capped to the smallest settings and still takes minutes. On your own machine there is no cap:

cargo install cortiq-cli
hf download infosave/MiniMax-H3-Turbo-cmf mmh3-turbo-q4tp.cmf --local-dir .
CMF_MMH3_GPU=1 cortiq animate mmh3-turbo-q4tp.cmf \
    --prompt "A corgi in a chef hat flipping a pancake, sizzling and a bark." \
    --width 512 --height 288 --frames 39 --out clip.avi