ollama compatibility
#1
by pouria98sarmasti - opened
when i want to use model in ollama i get this error: "unable to load model"
i tried these quantizations, and all return same error: q4_k_m, q8_0
when i want to use model in ollama i get this error: "unable to load model"
i tried these quantizations, and all return same error: q4_k_m, q8_0