How can I do quantization on my own?
#1
by
rusauron - opened
Sorry to bother you, but how do you quantify new types of models? Using llama.cpp ? I would be very grateful for the link to the instructions on how to do it yourself under windows.
YarvixPA changed discussion status to
closed