Llama-3.2-1B-4bit / quantize_config.json

Commit History

AutoGPTQ model for meta-llama/Llama-3.2-1B: 4 bits, gr128, desc_act=False
a6aae7d
verified

Jimmy1229 commited on