vicuna-7b-4bit / quantize_config.json

Commit History

AutoGPTQ model for lmsys/vicuna-7b-v1.3: 4bits, gr128, desc_act=False
10bd694

smjain commited on