Q4_0 does not work either in ollama :(
#4 opened 4 months ago
by
GrigorG
Does not work in ollama hf.co/bartowski/Qwen2.5-Math-72B-Instruct-GGUF:Q4_K_M
1
#3 opened 4 months ago
by
GrigorG
Supporting GPTQ/AWQ
#2 opened about 1 year ago
by
fzyzcjy
Fail to run "Qwen2.5-Math-72B-Instruct-Q8_0" with ollama
1
#1 opened about 1 year ago
by
weweus