Gguf

#1939
by gss1147 - opened

I think these ones say (static repository does not exist or could not be loaded.
imatrix repository does not exist or could not be loaded.

well yeah, we sadly dont have omnipotent hardware, it might take some time to quant, especially because we are quite bottlenecked by huge models that were quanted recently

Okay, thank you for your time and hard work. I’ll go ahead and do the GGUF quantize on my tiny models. Have a good day thank you

gss1147 changed discussion status to closed

they will be there eventually, just keep checking the queue in case they break or something ...

Sign up or log in to comment