File size: 271 Bytes
cc5d135 | 1 2 3 4 5 6 7 8 9 | ---
base_model:
- TheDrummer/UnslopNemo-12B-v4
pipeline_tag: text-generation
tags:
- fp8
---
FP8-Dynamic quant of [TheDrummer/UnslopNemo-12B-v4](https://huggingface.co/TheDrummer/UnslopNemo-12B-v4) using [llm-compressor](https://github.com/vllm-project/llm-compressor/). |