Reza2kn's picture
Upload AWQ INT4 MiniCPM5-1B
ba3c4e3 verified
|
Raw
History Blame Contribute Delete
253 Bytes
metadata
license: apache-2.0
base_model: openbmb/MiniCPM5-1B
tags:
  - awq
  - int4
  - minicpm5
  - text-generation

MiniCPM5-1B AWQ INT4

4-bit AWQ quantization of openbmb/MiniCPM5-1B.

  • Weight bits: 4
  • Group size: 128
  • Zero point: true
  • Version: GEMM