Instructions to use Efficient-Large-Model/Sol-Attn-Kernel-Source with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use Efficient-Large-Model/Sol-Attn-Kernel-Source with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("Efficient-Large-Model/Sol-Attn-Kernel-Source") - Notebooks
- Google Colab
- Kaggle
| """SM120 kernel recipe.""" | |
| from .mainloop import SolAttnForwardSm120 | |
| def make_kernel( | |
| *, | |
| debug_route_trace: bool = False, | |
| prefetch_first_exact_k: bool = True, | |
| prefetch_next_route_k: bool = True, | |
| ): | |
| return SolAttnForwardSm120( | |
| debug_route_trace=debug_route_trace, | |
| prefetch_first_exact_k=prefetch_first_exact_k, | |
| prefetch_next_route_k=prefetch_next_route_k, | |
| ) | |
| __all__ = ["make_kernel"] | |