gguf-kernels / vendor /UPSTREAM
marcsun13's picture
marcsun13 HF Staff
GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
2c20074 verified
Raw
History Blame Contribute Delete
79 Bytes
https://github.com/ggml-org/llama.cpp
432d7ffe2c3b4e539f3d0d4ae0a4893090a018d6