FastH3 Omni FP8

FP8 diffusion weights for FastH3 Omni, the eight-evaluation reference-conditioned video-and-audio model. This is the FastVideo-format FP8 variant of the BF16 release.

Release collection · FastVideo inference guide

Use with FastVideo

Follow the FastH3 Omni device and memory guide. The FP8 transformer is useful on GPUs without FP4 tensor cores, including RTX 4090 and Hopper, and on Blackwell when FP8 is preferred. The RTX 4090 profile uses layerwise transformer offload and the dense video VAE.

The bundled text encoder is NVFP4 and needs Blackwell FP4 kernels. On non-FP4 hardware, compose the transformer with compatible BF16 text-encoder components from MiniMax-H3 rather than selecting that bundled encoder. The guide explains model-directory composition and memory requirements.

For UniServe deployments on GB200/B200, RTX PRO 6000 Blackwell or Hopper, start from the BF16 release and follow the UniServe guide. For Spark and RTX 5090 local inference, use the NVFP4 QAD variant with FastVideo's matching profiles.

Contents

Component Purpose
transformer_ref/ FP8 reference-conditioned transformer with BF16 sensitive components
transformer/ Alternate directory containing the same transformer weights
text_encoder/ NVFP4 Qwen3-VL text and vision encoder; Blackwell only
vae/, audio_vae/ Video and audio VAEs
scheduler/, audio_scheduler/, processor/, tokenizer/ Sampling and input processing
fastvideo_inference.json Eight-evaluation FastH3 Omni inference configuration
adaln_table.pt Precomputed modulation table for the supplied schedule

FP8 quantization changes numerical output relative to BF16. These weights use the FastVideo FP8 layout; use the FP8 ComfyUI variant for ComfyUI.

Local AI resources

Run FastH3 Omni on DGX Spark or RTX 5090 through FastVideo using the FastVideo-format NVFP4 QAD weights. Start with the FastVideo cookbook and FastH3 Omni recipe builder; use the Spark recipe or RTX 5090 recipe and the local inference guide for the AdaLN table, offload and decoder setup.

FP8 weights are a separate FastVideo variant; the FP8 recipe for RTX 4090 illustrates the non-FP4 path with layerwise offload and compatible BF16 encoder components. Use each runtime's matching checkpoint format.

License

Use of these weights is governed by the MiniMax-H3 Community License Agreement.

Downloads last month
80
Safetensors
Model size
35B params
Tensor type
F32
·
BF16
·
F8_E4M3
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for FastVideo/FastH3-Omni-FP8

Finetuned
(7)
this model

Space using FastVideo/FastH3-Omni-FP8 1

Collection including FastVideo/FastH3-Omni-FP8