| license: apache-2.0 | |
| base_model: openbmb/MiniCPM5-1B | |
| tags: | |
| - nvfp4 | |
| - compressed-tensors | |
| - llm-compressor | |
| - minicpm5 | |
| - text-generation | |
| # MiniCPM5-1B NVFP4 | |
| NVFP4 weight-only quantization of `openbmb/MiniCPM5-1B` using `llm-compressor` / `compressed-tensors`. | |
| Best runtime target: Blackwell-class NVIDIA GPUs with vLLM support for NVFP4. | |