Hugging Face's logo

SicariusSicariiStuff
/
Angelic_Eclipse_12B

Safetensors
English
mistral
Model card Files
xet
Community
SicariusSicariiStuff commited on
Commit
2bce163
·
verified ·
1 Parent(s): 36961d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -304,6 +304,7 @@ $Scenario:
304
  - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B)
305
  - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GGUF) | [iMatrix](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_HA_NL)
306
  - GPTQ: [4-Bit-16](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-16) | [4-Bit-32](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-32) | [4-Bit-64](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-64) | [4-Bit-128](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-128)
 
307
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_FP8)
308
  - Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_ARM) | [Q4_0_High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_ARM_HA)
309
 
 
304
  - Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B)
305
  - GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GGUF) | [iMatrix](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_HA_NL)
306
  - GPTQ: [4-Bit-16](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-16) | [4-Bit-32](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-32) | [4-Bit-64](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-64) | [4-Bit-128](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_GPTQ_4-bit-128)
307
+ - AWQ: [4-Bit](https://huggingface.co/isola-tropicale/Angelic_Eclipse_12B-AWQ-4bit)
308
  - Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_FP8)
309
  - Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_ARM) | [Q4_0_High-Attention](https://huggingface.co/SicariusSicariiStuff/Angelic_Eclipse_12B_ARM_HA)
310