metadata
license: apache-2.0
base_model: openbmb/MiniCPM5-1B
tags:
- nvfp4
- compressed-tensors
- llm-compressor
- minicpm5
- text-generation
MiniCPM5-1B NVFP4
NVFP4 weight-only quantization of openbmb/MiniCPM5-1B using llm-compressor / compressed-tensors.
Best runtime target: Blackwell-class NVIDIA GPUs with vLLM support for NVFP4.