This is pretty cool! I read about your model release on Reddit. GGUFs is what's stopping me from testing it.
#3
by MysteriousPlane - opened
I used your demo website to test out the model, and it's really coherent and different than SOTA LLMs. Short and sweet responses. I want to run this, can you please create the GGUFs? At least Q8 would be appreciated!
Thanks for spending a ton of money and making this MIT!! For ref. I have 16gb of VRAM and 64gb of sys RAM!