| license: apache-2.0 | |
| base_model: openbmb/MiniCPM5-1B | |
| tags: | |
| - awq | |
| - int4 | |
| - minicpm5 | |
| - text-generation | |
| # MiniCPM5-1B AWQ INT4 | |
| 4-bit AWQ quantization of `openbmb/MiniCPM5-1B`. | |
| - Weight bits: 4 | |
| - Group size: 128 | |
| - Zero point: true | |
| - Version: GEMM | |
| license: apache-2.0 | |
| base_model: openbmb/MiniCPM5-1B | |
| tags: | |
| - awq | |
| - int4 | |
| - minicpm5 | |
| - text-generation | |
| # MiniCPM5-1B AWQ INT4 | |
| 4-bit AWQ quantization of `openbmb/MiniCPM5-1B`. | |
| - Weight bits: 4 | |
| - Group size: 128 | |
| - Zero point: true | |
| - Version: GEMM | |