Mistral Magnum Diamond PaperWitch Heresy

#1881
by redaihf - opened

Thanks @MuXodious !

It's queued!

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#MS3.2-24B-Magnum-Diamond-PaperWitch-heresy-GGUF for quants to appear.

There has been an error in this quantisation process.

 -6966   48  I MS3.2-24B-Magnum-Diamond-PaperWitch-heresy   error/47 1/24,Q2_K

Some models can be too claustrophobic to fit inside a tiny Q2 or less.

Thanks a lot for letting me know. No worries I fixed it. I updated llama.cpp and it is working now:

-6966   48  I MS3.2-24B-Magnum-Diamond-PaperWitch-heresy   run/imatrix 1/24,Q2_K [17/363]

Not sure if the old llama.cpp version had a issue or if it simply broke due to it trying to start quantizing exactly while llama.cpp was updating.

Sign up or log in to comment