File size: 5,432 Bytes
61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 bdfc13f 61ee8d6 bdfc13f 61ee8d6 96cd3df 61ee8d6 96cd3df ddd1746 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 bdfc13f 61ee8d6 bdfc13f 61ee8d6 bdfc13f 61ee8d6 bdfc13f 61ee8d6 96cd3df 61ee8d6 96cd3df ddd1746 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df bdfc13f 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 96cd3df 61ee8d6 bdfc13f f3b76ff bd0c248 61ee8d6 96cd3df | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 | ---
license: other
license_name: minimax-h3-community-license-agreement
license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
base_model: MiniMaxAI/MiniMax-H3
tags:
- video
- vae
- decoder
- nvfp4
- fp4
- blackwell
- fastvideo
- minimax-h3
---
# FastH3 NVFP4 VAE Decoder
Blackwell NVFP4 video decoders for MiniMax-H3 and FastH3, including FastH3 Omni. They replace the video decoder while retaining the reference encoder, audio VAE and video latent space.
[FastVideo](https://github.com/hao-ai-lab/FastVideo) · [FastH3 Omni decoder setup](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) · [FastH3 Omni release collection](https://huggingface.co/collections/FastVideo/fasth3-omniref)
## Choose a decoder
| Tier | Folder | Decoder layers | Resident decoder weights |
| --- | --- | ---: | ---: |
| Quality | `quality-36L/` | 36 | 1.29 GiB |
| Fast | `fast-8L/` | 8 | 0.31 GiB |
Choose the quality tier for closer reconstruction or the fast tier for lower decode cost with a quality tradeoff. Both tiers are lossy.
## Use with FastVideo
Download a packed decoder:
```bash
hf download FastVideo/FastH3-NVFP4-VAE-Decoder \
quality-36L/decoder-nvfp4.safetensors --local-dir ./fasth3-vae
```
Follow the [FastVideo FastH3 Omni guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) and pass the downloaded file with `--decoder` to `examples/inference/basic/basic_fasth3_omniref_pdd.py`. Use `fast-8L/decoder-nvfp4.safetensors` to select the fast tier instead.
The 36-layer decoder needs a full 36-layer MiniMax-H3 host VAE. The 8-layer tier also works with the light H3 VAE. The FastH3 Omni guide explains model composition and device profiles.
For UniServe deployment of the complete FastH3 Omni model on GB200/B200, RTX PRO 6000 Blackwell or Hopper, follow the [UniServe guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md) with the [BF16 model](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1). These files are FastVideo decoder components, not complete diffusion checkpoints.
## Hardware
The FP4 decoder kernels require NVIDIA Blackwell: GB200/B200, RTX PRO 6000 Blackwell, RTX 50-series or DGX Spark (GB10). Follow the [local FastH3 Omni guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md#device-profiles) for Spark and RTX 5090 setup. Hopper and older GPUs should use the original H3 video decoder.
## Files
Each tier includes:
- `decoder-nvfp4.safetensors`: packed NVFP4 weights for inference.
- `decoder.safetensors`: BF16 master weights.
- `config.json`: decoder architecture and quantization configuration.
## Quality and speed
Reconstruction against the original FP32 decoder on the same latents; lower LPIPS and higher PSNR are better:
| Evaluation clips | Quality tier LPIPS / PSNR | Fast tier LPIPS / PSNR |
| --- | ---: | ---: |
| FastH3 V2 generations, 9 clips at 480p | 0.0104 / 37.9 dB | 0.0684 / 28.5 dB |
| FastH3 Omni generations, 20 clips | 0.0039 / 46.0 dB | 0.0276 / 36.1 dB |
| Real videos, VAE-encoded, 6 held-out clips | 0.0038 / 45.0 dB | 0.0330 / 34.3 dB |
Warm video-decode time for one 832×480, 124-frame clip on one GB200, using FastVideo's fused NVFP4 kernels and batching all spatial tiles in one decoder call:
| Decoder | Seconds per clip |
| --- | ---: |
| Original FP16 decoder with `torch.compile` | 0.98 |
| Quality, 36 layers | 0.53 |
| Fast, 8 layers | 0.13 |
These are decoder-only measurements. Full video/audio generation also includes encoding, denoising and media output.
## Local AI resources
Run FastH3 Omni on **DGX Spark or RTX 5090 through FastVideo** using the [FastVideo-format NVFP4 QAD weights](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD). Start with the [FastVideo cookbook](https://haoailab.com/FastVideo/cookbook/) and [FastH3 Omni recipe builder](https://haoailab.com/FastVideo/cookbook/minimax-h3/fasth3-omniref/); use the [Spark recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_spark.yaml) or [RTX 5090 recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx5090.yaml) and the [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) for the AdaLN table, offload and decoder setup.
[FP8 weights](https://huggingface.co/FastVideo/FastH3-OmniRef-FP8) are a separate FastVideo variant; the [FP8 recipe for RTX 4090](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx4090.yaml) illustrates the non-FP4 path with layerwise offload and compatible BF16 encoder components. Use each runtime's matching checkpoint format.
## Acknowledgements
FastH3 Omni was built in close collaboration with [Nuva Lab](https://nuvalab.ai/fasth3/), which co-developed the model with FastVideo, defined and curated the omni reference dataset, and brought production-grounded creative video workflows to FastH3. For dedicated production deployment, fine-tuning on your own data and a creative agent on top, see [Nuva Lab's FastH3-Omni page](https://nuvalab.ai/fasth3/).
Thanks also to the NVIDIA FastGen team.
## License
Use of these weights is governed by the [MiniMax-H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).
|