Prototype-L2-GPTQ / README.md
IHaBiS's picture
Create README.md
8586c33
Models from https://huggingface.co/nRuaif/Prototype-L2
Only gptq-4bit-32g-actorder_True is supported for now
in oobabooga you can use it with python download-model.py IHaBiS/Prototype-L2-GPTQ --branch gptq-4bit-32g-actorder_True code.