Add q4_k GGUF
verified 
mudler commited on Add q5_0 GGUF
verified mudler commited on Add q5_k GGUF
verified mudler commited on Add q6_k GGUF
verified mudler commited on Add q8_0 GGUF
verified mudler commited on Add f16 GGUF
verified mudler commited on Add q4_0 GGUF
verified mudler commited on initial commit
verified mudler commited on 