MiniMax-H3 GGUF

GGUF for MiniMax-H3, compatible on most platforms including stablediffusion.cpp, ComfyUI, Unsloth and more.

Run MiniMax-H3 via Unsloth

You can run MiniMax-H3 via Unsloth: https://github.com/unslothai/unsloth/

GGUF quantizations of MiniMaxAI/MiniMax-H3

MiniMax H3 is an omni-modal generative system that produces video with native stereo audio, up to 15 seconds at 24 FPS with 32 kHz stereo audio. The files here quantize the fl2va_pruned H3-Base first-and-last-frame variant, which takes zero, one or two input images plus text. Both halves of the runtime are in this repo: the denoiser and the Qwen3-VL text encoder it needs.

Example

UD-Q2_K_XL, the smallest rung here, at 960x544, 124 frames, 24 FPS, 8 steps, guidance 1.0, seed 11, on a single card.

a red panda stepping along a mossy log in a misty forest, cinematic

The GIF is downsampled and silent. For the full 960x544 clip with its native 32 kHz stereo audio track, play assets/h3_gguf_ud_q2_k_xl.mp4. H3 generates the audio jointly with the video, so the audio is part of the model output rather than something added afterwards.

Files

File Size
minimax_h3_fl2va_pruned-Q2_K.gguf 6.26 GiB
minimax_h3_fl2va_pruned-UD-Q2_K_XL.gguf 7.51 GiB
minimax_h3_fl2va_pruned-Q3_K.gguf 8.16 GiB
minimax_h3_fl2va_pruned-UD-Q3_K_XL.gguf 8.90 GiB
minimax_h3_fl2va_pruned-Q4_K.gguf 10.64 GiB
minimax_h3_fl2va_pruned-Q5_0.gguf 12.97 GiB
minimax_h3_fl2va_pruned-Q6_K.gguf 15.45 GiB
minimax_h3_fl2va_pruned-Q8_0.gguf 19.97 GiB
qwen3vl_32b_minimax_h3-Q2_K_M.gguf 12.20 GiB
qwen3vl_32b_minimax_h3-Q4_K_M.gguf 16.97 GiB

The UD- rungs are dynamic, mixed-precision builds. The uniform rungs hold one type throughout. Pair the Q2_K_M text encoder with the two smallest denoisers and the Q4_K_M one with everything else. The VAEs are not duplicated here, take them from Comfy-Org/MiniMax-H3.

sd-cli --mode vid_gen \
  --diffusion-model minimax_h3_fl2va_pruned-UD-Q2_K_XL.gguf \
  --llm qwen3vl_32b_minimax_h3-Q2_K_M.gguf \
  --vae minimax_h3_video_vae_fp16.safetensors \
  --audio-vae minimax_h3_audio_vae_fp32.safetensors \
  --prompt "a red fox trotting through falling snow, cinematic" \
  --width 640 --height 384 --video-frames 25 --steps 4 --cfg-scale 1.0 \
  --backend te=cpu --diffusion-fa \
  --output out.webm

Three flags are not optional. --mode vid_gen, or H3 takes the image path and aborts. Explicit --cfg-scale 1.0, because H3 is distilled and cfg-free and aborts above 1.0 while the default is 7.0. And --backend te=cpu, which keeps the 12 GB text encoder off the card. Add --offload-to-cpu to fit a smaller GPU.

The pre-quantized PyTorch checkpoints are in unsloth/MiniMax-H3-FP8.

Licence

MiniMax H3 Community License Agreement, from MiniMax-H3. Full text in LICENSE. Read it before use: it defines an Applicable Territory and excludes some jurisdictions from it. MiniMax also publish a Q&A about the licence.

These files are Model Derivatives, not a plain copy: the transformer and the text encoder are quantized, which changes the numerics. Section III of the licence wants that stated, so NOTICE lists every change along with the attribution. Not an official MiniMax product, and not endorsed by MiniMax.

Downloads last month
15
GGUF
Model size
20B params
Architecture
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for unsloth/MiniMax-H3-GGUF

Quantized
(37)
this model