Needs updating
#2
by micsthepick - opened
Not sure if supported yet by text-gen-webui, but at the very least I think it should use the different branch format that other models are currently using.
Sorry what do you mean by the different branch format? I use different branches for GPTQs, and this is a GGML. I never managed to get reliably working GPTQs of MPT 30B models.
micsthepick changed discussion status to closed