MMLU Pro benchmark for GGUFs (1 shot)
Collection
"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX • 13 items • Updated • 9
Patterson
MartinPatterson
AI & ML interests
None yet
Recent Activity
liked a model about 19 hours ago
mradermacher/OmniCoder-9B-i1-GGUF new activity 3 days ago
AesSedai/MiniMax-M2.5-GGUF:I'm on waiting list for AesSedai Minimax M2.7 Q4_K_M or similar... new activity 3 days ago
Intel/Qwen3.5-397B-A17B-int4-AutoRound:Intel/Qwen3.5-397B-A17B-int4-AutoRound.guff wanted!Organizations
None yet
upvoted a collection 4 months ago