Add Q4_K_M, Q6_K, Q8_0 GGUF quantisations for consumer GPUs 271d366 MarcoBarroca commited on Jun 6, 2025