Instructions to use Efficient-Large-Model/Sol-Attn-Kernel-Source with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use Efficient-Large-Model/Sol-Attn-Kernel-Source with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("Efficient-Large-Model/Sol-Attn-Kernel-Source") - Notebooks
- Google Colab
- Kaggle
| """Small host helpers shared by the architecture backends.""" | |
| from cutlass.cute.runtime import from_dlpack | |
| def to_cute_tensor(tensor): | |
| return from_dlpack( | |
| tensor, | |
| assumed_align=16, | |
| enable_tvm_ffi=True, | |
| ).mark_layout_dynamic(leading_dim=tensor.ndim - 1) | |
| __all__ = ["to_cute_tensor"] | |