Instructions to use unsloth/MiniMax-H3-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use unsloth/MiniMax-H3-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/MiniMax-H3-GGUF", max_seq_length=2048, )
How can I get these pruned GGUFs to work in ComfyUI?
All existing GGUF loaders return the error “This model is not currently supported - (Unknown model architecture!)”. How can I load these pruned models into ComfyUI?
I found the solution. https://github.com/city96/ComfyUI-GGUF/issues/471 His GGUF fork loads them: https://github.com/molbal/ComfyUI-GGUF
Passed the GGUF loader but got this error: "SamplerCustomAdvanced failed"
I'm using this workflow: https://comfy.org/workflows/a781503cf508-a781503cf508
I'm using the workflow from Rebel, and everything is working fine. https://huggingface.co/realrebelai/MiniMax-H3_GGUFs/tree/main
Apologies, that was my mistake; I had not set the pixel count as a multiple of 32. The fork works excellently.
Tried all GGUF loaders redownload text encoders.
ValueError: This gguf file is incompatible with llama.cpp!
Consider using safetensors or a compatible gguf file
(\qwen3vl_32b_minimax_h3-Q2_K_M.gguf)