EXL2 Quantisations
Hi, I've created a few EXL2 quantisations over at https://huggingface.co/CameronRedmore/Gemma-2-Ataraxy-9B-exl2
I'm unsure as to whether you're interested in adding these to the README at all, but please feel free to do so if you think it's useful!
Thanks for the great model!
Cameron
== CLOSED & RE-OPENED DUE TO ISSUE WITH REPO ==
Hi, I've created a few EXL2 quantisations over at https://huggingface.co/CameronRedmore/Gemma-2-Ataraxy-9B-exl2
I'm unsure as to whether you're interested in adding these to the README at all, but please feel free to do so if you think it's useful!
Thanks for the great model!
Cameron== CLOSED & RE-OPENED DUE TO ISSUE WITH REPO ==
Thanks! I've added a link to your quants in the model card.
Thanks very much, it's greatly appreciated!
Have a great day :)