looking forward to the quantized versions for edge deployment
#3
by tomasmcm - opened
pretty cool model you got here. I hope you are considering releasing a quantized version as well, so we can try running this on SBCs, phones, tablets 🙏
Hi Tomas, we are working on quantizing the model and will update here when we have more to share!
Hello do you have any news about GGUF ?