gguf-kernels / tests
3.75 kB
marcsun13's picture
marcsun13 HF Staff
GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
2c20074 verified