NEW MODEL ALERT Wizardcoder-guanaco
Hey i just found what could potentially be an amazing new model. If you can quantize it that would be huge. It combines wizard coder with the qlora of guanaco
https://huggingface.co/LoupGarou/WizardCoder-Guanaco-15B-V1.0
If you dont mind, id love a GPTQ version first 😁 so i can run it in oobagooba. That is if the recourses are out there to quantize it.
Hey @TheBloke I found another model/set of models that might be interesting to quantize or at least pay attention to. Idk if you've seen them but these openchat models from the description seem to preform really well. I havnt tested them myself but if the readme is accurate they might be worth looking into. I linked the coding model but all the models on their hugging page are worth looking at