| license: apache-2.0 | |
| language: | |
| - pl | |
| tags: | |
| - fp8 | |
| base_model: CYFRAGOVPL/PLLuM-12B-instruct | |
| # cmsptcp/PLLuM-12B-instruct-FP8-Dynamic | |
| The Model [cmsptcp/PLLuM-12B-instruct-FP8-Dynamic](https://huggingface.co/cmsptcp/PLLuM-12B-instruct-FP8-Dynamic) was converted to FP8 format from [CYFRAGOVPL/PLLuM-12B-instruct](https://huggingface.co/CYFRAGOVPL/PLLuM-12B-instruct) using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor.git) version **v0.6.0**. | |