How to use kernels-community/quantization-bitsandbytes with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/quantization-bitsandbytes")
a3eb31a
1
2
3
from .custom_ops import gemm_4bit_forward __all__ = ["gemm_4bit_forward"]
