Very Large GGUFs
Collection
GGUF quantized versions of very large models - over 100B parameters • 83 items • Updated • 7
Bryan Funk
bryanfunk
AI & ML interests
AMD Ryzen AI 9 HX 370
Recent Activity
upvoted a collection 8 days ago
Very Large GGUFs liked a model 6 months ago
ResembleAI/chatterbox-turbo-ONNX reacted to danielhanchen's post with 🔥 7 months ago
Qwen3-Next can now be Run locally! (30GB RAM)
Instruct GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
💜 Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next
Thinking GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Thinking-GGUFOrganizations
None yet