--- license: other license_name: minimax-h3-community-license-agreement license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE base_model: MiniMaxAI/MiniMax-H3 tags: - video - vae - decoder - nvfp4 - fp4 - blackwell - fastvideo - minimax-h3 --- # FastH3 NVFP4 VAE Decoder Blackwell NVFP4 video decoders for MiniMax-H3 and FastH3, including FastH3 Omni. They replace the video decoder while retaining the reference encoder, audio VAE and video latent space. [FastVideo](https://github.com/hao-ai-lab/FastVideo) · [FastH3 Omni decoder setup](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) · [FastH3 Omni release collection](https://huggingface.co/collections/FastVideo/fasth3-omniref) ## Choose a decoder | Tier | Folder | Decoder layers | Resident decoder weights | | --- | --- | ---: | ---: | | Quality | `quality-36L/` | 36 | 1.29 GiB | | Fast | `fast-8L/` | 8 | 0.31 GiB | Choose the quality tier for closer reconstruction or the fast tier for lower decode cost with a quality tradeoff. Both tiers are lossy. ## Use with FastVideo Download a packed decoder: ```bash hf download FastVideo/FastH3-NVFP4-VAE-Decoder \ quality-36L/decoder-nvfp4.safetensors --local-dir ./fasth3-vae ``` Follow the [FastVideo FastH3 Omni guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) and pass the downloaded file with `--decoder` to `examples/inference/basic/basic_fasth3_omniref_pdd.py`. Use `fast-8L/decoder-nvfp4.safetensors` to select the fast tier instead. The 36-layer decoder needs a full 36-layer MiniMax-H3 host VAE. The 8-layer tier also works with the light H3 VAE. The FastH3 Omni guide explains model composition and device profiles. For UniServe deployment of the complete FastH3 Omni model on GB200/B200, RTX PRO 6000 Blackwell or Hopper, follow the [UniServe guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md) with the [BF16 model](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1). These files are FastVideo decoder components, not complete diffusion checkpoints. ## Hardware The FP4 decoder kernels require NVIDIA Blackwell: GB200/B200, RTX PRO 6000 Blackwell, RTX 50-series or DGX Spark (GB10). Follow the [local FastH3 Omni guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md#device-profiles) for Spark and RTX 5090 setup. Hopper and older GPUs should use the original H3 video decoder. ## Files Each tier includes: - `decoder-nvfp4.safetensors`: packed NVFP4 weights for inference. - `decoder.safetensors`: BF16 master weights. - `config.json`: decoder architecture and quantization configuration. ## Quality and speed Reconstruction against the original FP32 decoder on the same latents; lower LPIPS and higher PSNR are better: | Evaluation clips | Quality tier LPIPS / PSNR | Fast tier LPIPS / PSNR | | --- | ---: | ---: | | FastH3 V2 generations, 9 clips at 480p | 0.0104 / 37.9 dB | 0.0684 / 28.5 dB | | FastH3 Omni generations, 20 clips | 0.0039 / 46.0 dB | 0.0276 / 36.1 dB | | Real videos, VAE-encoded, 6 held-out clips | 0.0038 / 45.0 dB | 0.0330 / 34.3 dB | Warm video-decode time for one 832×480, 124-frame clip on one GB200, using FastVideo's fused NVFP4 kernels and batching all spatial tiles in one decoder call: | Decoder | Seconds per clip | | --- | ---: | | Original FP16 decoder with `torch.compile` | 0.98 | | Quality, 36 layers | 0.53 | | Fast, 8 layers | 0.13 | These are decoder-only measurements. Full video/audio generation also includes encoding, denoising and media output. ## Local AI resources Run FastH3 Omni on **DGX Spark or RTX 5090 through FastVideo** using the [FastVideo-format NVFP4 QAD weights](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD). Start with the [FastVideo cookbook](https://haoailab.com/FastVideo/cookbook/) and [FastH3 Omni recipe builder](https://haoailab.com/FastVideo/cookbook/minimax-h3/fasth3-omniref/); use the [Spark recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_spark.yaml) or [RTX 5090 recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx5090.yaml) and the [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) for the AdaLN table, offload and decoder setup. [FP8 weights](https://huggingface.co/FastVideo/FastH3-OmniRef-FP8) are a separate FastVideo variant; the [FP8 recipe for RTX 4090](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx4090.yaml) illustrates the non-FP4 path with layerwise offload and compatible BF16 encoder components. Use each runtime's matching checkpoint format. ## Acknowledgements FastH3 Omni was built in close collaboration with [Nuva Lab](https://nuvalab.ai/fasth3/), which co-developed the model with FastVideo, defined and curated the omni reference dataset, and brought production-grounded creative video workflows to FastH3. For dedicated production deployment, fine-tuning on your own data and a creative agent on top, see [Nuva Lab's FastH3-Omni page](https://nuvalab.ai/fasth3/). Thanks also to the NVIDIA FastGen team. ## License Use of these weights is governed by the [MiniMax-H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).