Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
text-generation-inference
Model card Files
xet
 Community
15
New discussion

That wizardlm 8x22b is very advanced.!

🔥🚀 10
18
#8 opened about 2 years ago by
mirek190

Help regarding best quantization for below PC specification.

6
#15 opened about 2 years ago by
bikkikumarsha

AWQ and GPTQ plz

🔥 4
6
#11 opened about 2 years ago by
Parkerlambert123