jiyuanq/falcon-40b-instruct-gptq-128g-act

falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438

• group size: 128
• act order: true
• nsamples: 128
• dataset: wikitext2