Very Large GGUFs
Collection
GGUF quantized versions of very large models - over 100B parameters ā¢ 83 items ā¢ Updated ā¢ 7
Bryan Funk
bryanfunk
AI & ML interests
AMD Ryzen AI 9 HX 370
Recent Activity
upvoted a collection 8 days ago
Very Large GGUFs liked a model 6 months ago
ResembleAI/chatterbox-turbo-ONNX reacted to danielhanchen's post with š„ 7 months ago
Qwen3-Next can now be Run locally! (30GB RAM)
Instruct GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
š Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next
Thinking GGUF: https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Thinking-GGUFOrganizations
None yet
upvoted a collection 8 days ago
liked a
model 6 months ago
reacted to danielhanchen's post with š„ 7 months ago
Post
8602
Qwen3-Next can now be Run locally! (30GB RAM)
Instruct GGUF: unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
š Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next
Thinking GGUF: unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF
Instruct GGUF: unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF
The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
š Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next
Thinking GGUF: unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF
liked a
Space 8 months ago
upvoted 2
collections 9 months ago