Instructions to use galqiwi/flute_kernels with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use galqiwi/flute_kernels with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("galqiwi/flute_kernels") - Notebooks
- Google Colab
- Kaggle
| """Smoke example for galqiwi/flute_kernels.""" | |
| import torch | |
| from kernels import get_kernel | |
| flute = get_kernel("galqiwi/flute_kernels", version=1) | |
| x = torch.randn(4, 4096, device="cuda", dtype=torch.float16) | |
| y = flute.hadamard_transform(x, False) | |
| print(y.shape, y.dtype) | |