gguf-kernels / torch-ext /gguf_kernels
2.42 kB
marcsun13's picture
marcsun13 HF Staff
GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
2c20074 verified