MMLU Pro benchmark for GGUFs (1 shot)
Collection
"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX • 13 items • Updated
• 9
Pussy Hut
PussyHut
AI & ML interests
None yet
Recent Activity
new activity
about 1 month ago
unsloth/GLM-4.7-Flash-GGUF:NEW: LLama.cpp: Using `ngram-mod` to Get 2x Speed Boost on Long-Chats/Agent! new activity
about 2 months ago
unsloth/GLM-4.7-Flash-GGUF:High CPU Usage / Slow Context Processing new activity
about 2 months ago
unsloth/GLM-4.7-Flash-GGUF:High CPU Usage / Slow Context Processing Organizations
None yet
upvoted a collection 7 months ago