Hugging Face's logo

Nulia
/
UnslopNemo-12B-v4-FP8-Dynamic

Text Generation
Safetensors
mistral
fp8
conversational
compressed-tensors
Model card Files
xet
Community
Nulia commited on
Commit
cc5d135
·
verified ·
1 Parent(s): 1399773

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - TheDrummer/UnslopNemo-12B-v4
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - fp8
7
+ ---
8
+
9
+ FP8-Dynamic quant of [TheDrummer/UnslopNemo-12B-v4](https://huggingface.co/TheDrummer/UnslopNemo-12B-v4) using [llm-compressor](https://github.com/vllm-project/llm-compressor/).