A collection of 4Bit quantized models
-
Lumia101/EXAONE-4.0.1-32B-GGUF-Q4_K_M
Text Generation • 32B • Updated • 15 -
Lumia101/kanana-1.5-15.7b-a3b-instruct-Q4_K_M-GGUF
Text Generation • 16B • Updated • 3 -
Lumia101/GLM-Z1-9B-0414-Q4_K_M-GGUF
Text Generation • 9B • Updated • 4 -
Lumia101/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 1