hivata
/

functionary-small-v3.1-AWQ

functionary-small-v3.1-AWQ / README.md

Create README.md

5745fb0 verified over 1 year ago

86 Bytes

quant_config = {"zero_point": True, "q_group_size": 128, "w_bit": 4, "version":"GEMM"}