Q5_K_L can't be downloaded with ollama
#2
by tqdeas28 - opened
On the files tab, when I click Use this model -> ollama, popup window doesn't let me choose Q5_K_L version (seemingly the best one for 24Gb). Only K_S and K_M are available for Q5.
If I manually change the copied command to the version I want, ollama responds with:
pulling manifest
Error: pull model manifest: 400: {"error":"The specified tag is not a valid quantization scheme. Please use another tag or \"latest\""}
tqdeas28 changed discussion title from `Q5_K_L` can't be downloaded with ollama to Q5_K_L can't be downloaded with ollama