Llama-3.2-3B-4bit / quantize_config.json

Commit History

AutoGPTQ model for meta-llama/Llama-3.2-3B: 4 bits, gr128, desc_act=False
478d0ba
verified

Jimmy1229 commited on