Instructions to use ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir MiniMax-H3-FL2VA-MLX-Serve-8bit ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
MiniMax-H3 FL2VA โ MLX-Serve 8-bit
8-bit affine (group size 64) conversion of MiniMax-H3's FL2VA checkpoint for mlx-serve, running natively on Apple Silicon. Text-to-audio-video: the DiT denoises video and stereo audio jointly in one packed sequence.
Self-contained: weights, both VAEs and the tokenizer in one directory. Upstream
splits these across Comfy-Org/MiniMax-H3 (weights, no tokenizer) and
MiniMaxAI/MiniMax-H3 (tokenizer).
Quantized: the DiT and text-encoder matmul weights. Kept dense: gathered embedding tables, the checkpoint's fp32 islands (patch projections, output heads, time embedder) and both VAEs.
Note that quantization here buys FOOTPRINT, not speed โ the workload is compute-bound at roughly 192,000 FLOPs per weight byte.
Modifications
These are MODIFIED files. The transformer and text encoder are quantized to 8-bit; see MODIFICATIONS.md for the full list. The VAEs and tokenizer are unmodified copies.
License
Powered by MiniMax H3. Licensed under the MiniMax H3 Community License Agreement -- see LICENSE and NOTICE, both included here.
Territorial restriction. The Agreement defines the Applicable Territory as worldwide EXCLUDING the European Union, the United Kingdom, the Republic of Korea and the United States of America, and Section V.4 prohibits use, reproduction, modification, distribution and display outside it. Check whether your jurisdiction permits you to use these files before downloading them.
- Downloads last month
- -
Quantized
Model tree for ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit
Base model
MiniMaxAI/MiniMax-H3