mistralai/Leanstral-2603
I guess you don't want to quant this one?
Or you are just ignoring me?
Or both?
🤔
I did in fact queue it 2 days ago, but it was new model and while asking my friend if it will even work (I didnt know magic with mistral's configs)... I simply forgor (5 second memory)
Currently something broke with mistral compatibility, so sadly have to wait until it gets fixed, but dont worry, I didnt forget to queue you, I just forgot to answer...
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Leanstral-2603-GGUF for quants to appear.
This guy got it to work:
https://huggingface.co/jackcloudman/Leanstral-2603-GGUF
Or @danielhanchen for a UD Unsloth convert?
still locked in queue, waiting for the next llama cpp update on our systems to try to convert it