Fix 8-bit quantization bug, switch to 4-bit with BitsAndBytesConfig b7d24ee AKSazgar commited on Oct 28