| license: apache-2.0 | |
| base_model: Kiddyz/fine-lightning-14b | |
| tags: | |
| - text-generation | |
| - large-language-model | |
| - fp8 | |
| - quantized | |
| quantization_method: FP8-dynamic | |
| bits: 8 | |
| # fine-lightning-14b-FP8-Dynamic | |
| 这是对 [Kiddyz/fine-lightning-14b](https://huggingface.co/Kiddyz/fine-lightning-14b) 模型进行的 FP8 动态量化版本。 | |