gguf-kernels / torch-ext /torch_binding.cpp

Commit History

Metal: cover every quant type upstream's metallib has a gemv for
0becb0a

Marc Sun commited on

GGUF kernels: dequantize + fused gemv over packed blocks, 9 CUDA variants
2c20074
verified

marcsun13 HF Staff commited on