Instructions to use kernels-community/punica-sgmv with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/punica-sgmv with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/punica-sgmv") - Notebooks
- Google Colab
- Kaggle
F6: chunked multi-segment dispatch produces non-deterministic silent corruption at production scale
#3 opened about 1 month ago
by
alkari33
F2: silent wrong-results from add_lora_sgmv_cutlass on single segments above 144 tokens
#2 opened about 1 month ago
by
alkari33
F1: cu130 build segfaults on fp32 input, no documented dtype contract
#1 opened about 1 month ago
by
alkari33