ollama compatibility

#1
by pouria98sarmasti - opened

when i want to use model in ollama i get this error: "unable to load model"
i tried these quantizations, and all return same error: q4_k_m, q8_0

Sign up or log in to comment