---
base_model:
- TheDrummer/UnslopNemo-12B-v4
pipeline_tag: text-generation
tags:
- fp8
---

FP8-Dynamic quant of [TheDrummer/UnslopNemo-12B-v4](https://huggingface.co/TheDrummer/UnslopNemo-12B-v4) using [llm-compressor](https://github.com/vllm-project/llm-compressor/).