--- license: apache-2.0 language: - pl tags: - fp8 base_model: CYFRAGOVPL/PLLuM-12B-instruct --- # cmsptcp/PLLuM-12B-instruct-FP8-Dynamic The Model [cmsptcp/PLLuM-12B-instruct-FP8-Dynamic](https://huggingface.co/cmsptcp/PLLuM-12B-instruct-FP8-Dynamic) was converted to FP8 format from [CYFRAGOVPL/PLLuM-12B-instruct](https://huggingface.co/CYFRAGOVPL/PLLuM-12B-instruct) using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git) version **v0.6.0**.